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The content of this volume represents 
the proceedings of the Second Conference 
on Research in Psychotherapy held in 
Chapel Hill, North Carolina, May 17-20, 
1961, under the sponsorship of the Divi- 
sion of Clinical Psychology of the Amer- 
ican Psychological Association. The con- 
ference was financed by a research grant 
(M-4001) from the National Institute of 
Mental Health, Public Health Service. 

History 

The plan for a second conference had 
its inception at the first conference held 
in Washington, D. C, in 1958, which be- 
cause of its excellent planning and organi- 
zation was successful beyond expectation. 
At that time, many participants expressed 
the hope that it might be possible for 
research workers to meet again, to ex- 
change ideas, to follow up research proj- 
ects which were then getting under way, 
and to encourage critical examination of 
the major theoretical, methodological, and 
practical issues facing the investigator in 
this difficult field. The desirability of an- 
other conference was further underscored 
by the widespread interest in the first 
volume Research m Psychotherapy ( 1959), 
representing the proceedings of the first 
conference, which in a short period of 
time achieved the status of a standard 
reference. 

Psychotherapy, as a clinical art and as a 
scientific discipline, has become a major 
focus of interest for psychiatrists and 
psychologists over the past decades. It is 
specified as a major interest by more 
psychologists than any other single topic 
in the APA Directory; a large body of 
literature is tangible evidence of the thirst 
for systematic knowledge, proven tech- 
niques, and new methods for research; at 
meetings of scientific and professional or- 



ganizations large segments of time are 
devoted to symposia and papers; and the 
problem of training in psychotherapy is a 
major concern of all the mental health 
professions, as exemplified by the recent 
recommendations of the Joint Commis- 
sion on Mental Illness and Health (1961), 
However, progress in research has been 
slow. There are many reasons for this 
state of affairs, among which might be 
mentioned the inherent complexity of the 
subject matter, the relative recency of 
systematic research, the crudeness of exist- 
ing research methods, and the difficulties 
of obtaining adequate data. 

Thus, the Executive Committee of the 
Division of Clinical Psychology received 
favorably the recommendation of Dr. Eli 
A. Rubinstein, chairman of the planning 
committee for the first conference, to plan 
a second meeting. In the fall of 1958, 
Dr. Hans H. Strupp was appointed chair- 
man of an Ad Hoc Committee to plan the 
Second Conference on Research in Psycho- 
therapy. The other members of this com- 
mittee who shared the responsibility for 
this task included: Drs. John M. Butler, 
Jerome D. Frank, David A. Hamburg, 
Lester Luborsky, George Saslow, and 
William U. Snyder. Throughout the plan- 
ning period the Ad Hoc Committee main- 
tained its original composition and con- 
ducted its work through formal meetings 
and informal consultation. 

In 1959 a formal proposal for financial 
support of the conference was approved 
by the Board of Directors of the American 
Psychological Association and was sub- 
mitted to the National Institute of Mental 
Health, which approved a grant for the 
holding of the conference and for publi- 
cation of the proceedings. 

In deciding the format, organization, 
and content of the Second Conference, the 
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Ad Hoc Committee was guided by the 
results of a questionnaire survey in which 
the predecessor committee had solicited 
the opinions of participants at the first 
conference. In addition, the members of 
the Ad Hoc Committee, all of whom had 
participated in the first conference, drew 
on their own observations and impres- 
sions. The Committee benefited from the 
counsel of Dr. Eli Rubinstein, who ad- 
vised on a wide variety of problems which 
the Ad Hoc Committee encountered in 
its work. 

Aims 

In contrast to the first conference, which 
was intended to provide a comprehensive 
picture of ongoing research in the area of 
psychotherapy, the Second Conference at- 
tempted to deal more intensively with a 
few selected research issues relevant to 
individual psychotherapy with adult neu- 
rotic patients. In addition, it was designed 
to facilitate the review and follow-up of 
several projects which were in formative 
stages at the time of the first meeting; to 
consider recent research contributions and 
assess new research developments; to in- 
sure continuity of exchange of informa- 
tion among investigators; to guide and 
stimulate further research in the area; and, 
finally, to place research in psychotherapy 
more squarely within psychological re- 
search concerned with understanding in- 
terpersonal processes. 

In keeping with the objective of striv- 
ing for thoroughness of exploration of 
selected key issues rather than compre- 
hensive coverage of the field, the Com- 
mittee formulated three topics: 

1. Research problems relating to meas- 
uring personality change in psycho- 
therapy. The emphasis here rested on a 
thorough discussion of relevant variables 
in patients so as to allow significant assess- 
ments of change as a result of therapy; 
techniques for measuring personality 
change; selection of patients in terms of 
predictor variables. 



2. Research problems relating to the 
psychotherapists contribution to the treat- 
ment process. Questions to be dealt with 
under this heading included: ways of 
evaluating the contribution of the thera- 
pist's personality and attitudes upon 
progress and outcome of therapy; effects 
of variations in therapist behavior upon 
the process of therapy. 

3. Research problems relating to the 
definition, measurement, and analysis of 
significant variables in psychotherapy t 
such as transference, resistance, etc. The 
purpose here was to bridge the gap be- 
tween dynamic events observed in the 
clinical situation and their assessment and 
measurement by objective means. 

Conference Structure 

In order to insure maximum group par- 
ticipation and to facilitate relatively in- 
tensive exploration of each topic, the 
Committee decided to combine plenary 
sessions with small group meetings and 
to dispense with the formal presentation 
of papers. Thus, it was planned to devote 
the first day of the Conference to a plenary 
session, at which time there would be 
presented formal discussions of invited 
papers (which had been distributed to 
the participants in advance) representing 
the major topic areas, followed by in- 
formal group discussion. The second day 
was to comprise concurrent small group 
meetings in each topic area. On the third 
day, designated reporters from each group 
were to present the results of the small 
group meetings at another plenary ses- 
sion. Each presentation was to be followed 
by group discussion. Finally, a closing 
summary was intended to integrate the 
discussions. This organization was carried 
out, and is reflected in the Table of 
Contents. 

The selection of participants at any in- 
vitational conference presents multiple 
problems. In this case, the Committee 
stipulated that prospective participants 
should be persons who are either directly 
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engaged in research in psychotherapy 
relevant to the major topics, or others 
who might make valuable contributions 
to the discussion and criticism of research 
in this field (e.g., persons with strong 
clinical or theoretical talents). To provide 
for continuity, it was decided to include 
a number of investigators who had at- 
tended the first conference. To guide 
the selection, a questionnaire was mailed 
to a sizable number of potential partici- 
pants to explore their current research 
interests, the status of their research, and 
their interest in participating. The Com- 
mittee then evaluated the responses and 
exercised its best judgment in composing 
the final roster of participants. Clearly, a 
certain amount of subjectivity, bias, and 
arbitrariness was unavoidable. 

The Conference was held on the campus 
of the University of North Carolina, 
which lent a relaxing and contemplative 
atmosphere for the meeting. On the eve- 
ning preceding the Conference, at a dinner 
session, Dr. Jerome D. Frank presented 
an opening address on "The Role of Cog- 
nitions in Illness and Healing." 
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The Role of Cognitions in Illness and Healing 
JEROME D. FRANK, M.D. 



The task of making sense of psycho- 
therapy is not an easy one, as the partici- 
pants at this conference well know. The 
customary research approach is to confine 
oneself to a particular form of treatment 
and try either to isolate and manipulate 
certain of its components, or to encom- 
pass all its aspects at once and systematic- 
ally observe their interplay. Both types of 
research are well represented here. 

All are confined to the same general 
model of psychotherapy. The conditions 
it treats are conceived as resulting from 
the patient's distorted perceptions of him- 
self and others and the resulting mal- 
adaptive behavior. The therapist, through 
offering the patient a nonjudgmental, 
highly individualized, empathic attitude, 
and using certain specific methods, tries to 
create an interpersonal situation that will 
enable the patient to discover and correct 
his maladaptive patterns, and so gain more 
security and satisfaction from life. 

Because there are only two participants 
in the therapeutic interaction and the 
chief therapeutic instruments are words 
that can be recorded and studied at leisure, 
this form of therapy has obvious advan- 
tages for research. Viewed from the per- 
spective of the range of psychological ills 
affecting humanity and the means used to 
treat them, however, it is obviously a 
special case. The danger therefore exists 
that conceptualizations based solely on 
data obtained from it may contain errors 
of omission or emphasis. 

It therefore occurred to me that I might 
take this occasion to use a different ap- 
proach. Instead of the detailed exploration 
of one type of therapy, I shall consider 
some cognitive processes involved in all 
forms of treatment, using the term in a 
loose sense to include perceptions, con- 



cepts, expectations, judgments, and the 
like. 

In embarking on this enterprise one is 
immediately brought up short with the 
realization that psychotherapy is treat- 
ment for something, and cannot be studied 
independently from what it attempts to 
treat. And this requires some considera- 
tion of the concept of illness. In accord 
with conventional medical concepts, a 
distinction is often made between "or- 
ganic" and "psychological" illnesses. The 
former are viewed as the organism's re- 
sponse to tissue damage caused by trauma, 
infection, or metabolic disorder, the latter 
as difficulties in living resulting from in- 
ability to cope with personal conflicts or 
other psychological stresses (Szasz, I960). 
Empirical evidence suggests that this dis- 
tinction is probably not valid, but that 
so-called organic and psychological ill- 
nesses are often merely facets of the same 
maladaptive process. Life history studies 
of some 3,000 persons, for example, have 
shown that individuals differed in the 
amounts of illness they experienced and 
those with the greater number of bodily 
illnesses also reported the greater number 
of disturbances of mood, thought, and be- 
havior. Furthermore, in each person epi- 
sodes of sickness appeared in clusters 
when he was trying to adapt to a life 
situation perceived as stressful by him. 
That is, the clusters of bodily, mental, and 
behavioral disturbances occurred at times 
of conflict with his family, loss of signifi- 
cant social supports, and excessive de- 
mands, as he perceived them (Hinkle 
etal., 1957). 

The tendency for persons who are ill to 
be ill all over, as it were, was also found 
in a five-year follow-up study of psychi- 
atric outpatients. They were seen four 
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times at intervals of from six months to 
two years. Their reported illnesses during 
this period were crudely categorized as 
primarily psychiatric, primarily medical, 
and medical complaints with a psycho- 
logical basis. Of the 30 patients, 27 were 
checked in more than one category, and 
13 in all three. Twenty-seven were 
checked for chronic illness (lasting 
throughout one evaluation period) at least 
once; and 23, or about three-fourths, for 
both chronic and acute illnesses. As with 
the persons in the larger study, psychiatric 
outpatients tended to have a variety of 
illnesses, some "psychic," some "organic" 
(Stone etal., 1961). 

These findings suggest that all illnesses 
are failures of adaptation characterized by 
distress and disability and involving all 
levels of personal functioning biological, 
psychological, and social. Of course, the 
relative weights of these components 
differ in different illnesses. At one ex- 
treme would be acute bodily disturbances 
such as pneumonia or acute appendicitis. 
It is these illnesses which have created the 
concept of illness as a bodily state "caused" 
by a pathogen or pathological process and 
existing inside a patient. If the illness is 
brief, the psychosocial components can 
usually be ignored because recovery occurs 
before they become important. It is well 
recognized, however, that the disability 
and distress of the chronically ill is largely 
unrelated to the extent of their tissue 
damage, but depends chiefly on how their 
condition has affected their self-image, 
expectations for the future, and the atti- 
tudes of those about them. The anxiety 
and despair created by the interplay of 
these factors may aggravate the patho- 
logical processes, heighten the patient's 
suffering, and reduce his adaptive capacity. 
The treatment of a patient with chronic 
heart disease, for example, may have to 
be directed more to modifications of his 
attitudes and behavior than adjustment of 
dosage of digitalis. 

Recentlv a concept of illness has 



emerged that takes account of the com- 
mon features of all forms of sickness and 
methods of treatment. According to this 
view, the diagnosis of illness is a judg- 
ment made by the patient and those about 
him, which then has certain effects on his 
attitudes towards himself and his relation- 
ships with others (Ausubel, 1961). The 
judgment is based on three types of data: 
the person's subjective distress, his dis- 
ability, and information about his bodily 
processes. Any one of these may be suffi- 
cient to lead to a diagnosis of illness. Fot 
example, a depressed patient without 
identifiable organic damage and who was 
able to function adequately, would be 
judged to be ill solely on the basis of his 
subjective distress. An apathetic chronic 
schizophrenic would be diagnosed as ill 
because he could not carry out any of the 
tasks of life though he appeared to be in 
no distress and showed no evidence of 
chronic disease. Organic damage that 
affects neither the patient's subjective 
state nor his performance is considered 
to indicate illness when it forecasts future 
distress and disability. For example, a 
man may be perfectly well until a routine 
X ray reveals that he has asymptomatic 
cancer of the lung. This information im- 
mediately makes him ill, with full-scale 
psychosocial consequences. 

Not only the state of illness or health, 
but the specific nature of the illness is 
based on a judgment determined to a large 
extent by the setting in which it occurs, 
how it is regarded by the patient and 
others, and the way it is treated. This has 
been clarified by studies of patients with 
delayed convalescence from infectious dis- 
eases. In the Philippines during the last 
war I was asked to examine a number of 
hospitalized soldiers suffering from per- 
sistent weakness, shakiness, and headache. 
These symptoms were viewed by them and 
their physicians as evidences of continu- 
ing infestation with a liver parasite. The 
doctors had begun to wonder about this; 
hence, asked for an examination. Inter- 
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views with these soldiers dearly showed 
that their symptoms were actually mani- 
festations of resentment, fear, and depres- 
sion created by conflicts and uncertainties 
produced by the hospital milieu (Frank, 
1946). 

Recently this phenomenon has been 
pinpointed by two careful investigations. 
The first, a retrospective study, found that 
patients who failed to recover from bru- 
cellosis were more depressed, on various 
measures, than those who made a prompt 
recovery. Analysis of the data indicated 
quite convincingly that the depression was 
not merely secondary to the stress of ill- 
ness but was more critically related to the 
pre-illness personality structure and the 
concurrent life situation (Trever et al, 
1959; Cluff et al., 1959; Imboden et al, 
1959). To clinch the matter, the investi- 
gators then did a prospective study. The 
psychological tests were given to a large 
number of government personnel just 
prior to an expected influenza epidemic. 
Of those who became ill, patients who 
retained symptoms for more than three 
weeks had scored significantly higher on 
pre-illness measures of depression than 
those who recovered within two weeks, 
though the initial severity of the illness 
was the same in both groups (Imboden, 
Canter, & Cluff, 1961). 

These studies demonstrate that the pre- 
vious experience of certain patients, com- 
bined with a special treatment environ- 
ment, led them and their physicians to 
interpret symptoms of depression as evi- 
dence of failure to recover from a specific 
infectious disease. Before the psycholog- 
ical findings were known, they "had" the 
disease and were treated accordingly; the 
introduction of this new bit of informa- 
tion changed them from sick to "de- 
pressed." 

The role of situational cues in the defi- 
nition of disease can also be readily 
demonstrated in psychiatric patients. Vari- 
ous groups of patients were interviewed 



at a veterans hospital to determine 
whether they regarded their illness as 
psychological or organic Seventy-one per- 
cent of a group of male schizophrenics 
described their illnesses as psychological 
immediately after admission to the hos- 
pital. After four weeks of receiving 
nothing but drug therapy, the percentage 
dropped to 38 percent. Another group 
who were interviewed after having re- 
ceived an average of seven months of 
psychotherapy with drugs unanimously 
described their illnesses in psychological 
terms (Whitman & Duffey, 1961). 

Recently, a student nurse arrived as a 
patient at Phipps after many months on 
surgical and dental services at another 
hospital where she was being treated for 
persistent, severe spasm of the jaw that 
prevented her from dosing her mouth. 
The symptom started after a dislocation 
of the jaw while undergoing dentistry. 
She had been subjected to drastic proce- 
dures, induding surgical destruction of 
the temporo-mandibular joint, cutting of 
certain nerves bilaterally or rather at- 
tempted cutting which fortunately was 
largely unsuccessful and finally her jaws 
were wired together. To this point she, 
her physicians, and members of her social 
environment had defined her illness as 
physical and had a rationale for this 
judgment namely, that the spasm was 
caused by a so-called circular reflex insti- 
gated by the original dislocation. She was 
a patient with a surgical illness treated by 
surgeons. When they reached the end of 
their tether, they called a psychiatrist. His 
perception of her illness was that the 
spasm was related to severe conflicts about 
her choice of career. Conversations along 
these lines were followed by disappear- 
ance of the spasm, and she was transferred 
to a psychiatric service. The jaw symptom 
has not recurred, but she is involved in 
intense emotional turmoil over whether 
or not to continue in nurses' training. 
Now, even though her jaw joint is per- 
manently damaged, in the eyes of herself, 
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her colleagues, and her physicians, she has 
a mental illness. No surgeon or dentist 
has come near her and no one has laid a 
knife or needle upon her. Treatment con- 
sists in talks with a psychiatrist, some- 
times under hypnosis. It is unnecessary to 
labor the point that the diagnosis of this 
patient's illness as organic or psychological 
has depended largely on the settings in 
which she became ill, the persons with 
whom she interacted, and the treatment 
methods used. 

Implicit in the above examples is that 
distress, disability, or organic damage do 
not in themselves constitute illness. To 
warrant this designation they must, in ad- 
dition, be regarded as undesirable, as un- 
correctable by the person's own unaided 
efforts, and as curable by a culturally de- 
fined healer. Once a person is judged to 
be ill, he is relieved of his usual social 
responsibilities, in return for which he is 
expected to cooperate with his therapist 
(Parsons, 1951). 

Some examples may clarify these gen- 
eralizations. Disturbances of thought or 
behavior are considered to be signs of 
illness only if they are regarded as un- 
desirable. The visions of a religious mystic 
would be evidences of illness if reported 
by a patient in a state hospital. To the 
mystic and those who accept the validity 
of his experiences, they are evidences of 
saintliness, and any implication that they 
are signs of disease would be rejected. 

The questions as to whether or not a 
person can cure himself, and the extent to 
which he is to be absolved from his usual 
responsibilities are crucial with certain 
conditions whose status as illness thereby 
becomes a matter of controversy. Alcohol- 
ism is a good example. As long as a 
person's drinking stays within socially ac- 
ceptable bounds, no one would think him 
ill. After his drinking has become clearly 
undesirable to himself and others, as long 
as the alcoholic thinks he can "take it or 
leave it alone" he is not ill in his own eyes. 



Even after he realizes that he cannot con- 
trol his craving unaided, and so considers 
himself to be ill, others may refuse to 
consider him so because they believe he 
can stop by act of will. 

The alcoholic also illustrates the fact 
that the third ingredient, the culturally 
defined healer, is an integral part of the 
definition of illness. Many who realize 
that their condition is undesirable and 
that they are powerless to control it, go 
for help to AA instead of to a medical or 
psychiatric resource, and this keeps them 
out of the category of the sick. 

Before leaving this subject, it must be 
stressed that the issue of moral responsi- 
bility may arise with any illness, and 
therefore does not afford a sound basis for 
distinguishing neuroses from organic dis- 
ease. Examples of the difficulty of drawing 
such distinctions would be the diabetic 
whose condition is aggravated by volun- 
tary overeating, or the cardiac who ac- 
cepts a life of chronic dependency as op- 
posed to one with equal organic damage 
who continues to support himself. 

In short, the definition of all illness in- 
volves a consensus of the patient and his 
social unit based on his distress, his ap- 
parent disability, and information as to 
their presumed cause. If this information 
leads to the judgment that the person's 
state is undesirable, that he cannot correct 
it unaided, and that a socially designated 
healer can help him, he is ill. The distinc- 
tion between so-called organic and psychic 
illness is one of degree, not kind, depend- 
ing on such factors as the relative im- 
portance of identifiable bodily disorders, 
and the extent to which the person is 
believed to be responsible for his condi- 
tion and its rectification. 

Health, like illness, is a complex judg- 
ment based on evaluation of all aspects 
of a person's functioning. If a person says 
he feels well, performs well, and is re- 
garded as well by his family, colleagues, 
and friends, then, in the absence of in- 
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formation indicating that this condition 
cannot be maintained (as, for example, 
an X-ray diagnosis of lung cancer), I 
would maintain that he is well Until diag- 
nostic tools are developed that reliably 
predict future distress or disability in an 
apparently healthy person, the first three 
criteria must be regarded as offering an 
adequate determination of health. This 
state of affairs still obtains at the psycho- 
logical end of the illness continuum, 
though one may hope that progressive 
improvement of diagnostic methods at 
both psychological and physiological levels 
may alter it. 

Insofar as illness and health involve 
social judgments, treatment methods can 
be viewed in part as efforts to influence 
the patient's concept of himself and of the 
therapeutic procedure in a favorable di- 
rection. Psychotherapeutic procedures rely 
essentially on personal influence to do this. 
Any ill person may, under some circum- 
stances, benefit from psychotherapy. Per- 
suading the preoperative patient to sign 
a release and the chronic cardiac to resume 
activities commensurate with his cardiac 
reserve are forms of psychotherapy. 

This must not be taken to imply that 
psychotherapy may not have special fea- 
tures, nor that only physicians should con- 
duct this form of treatment. Though acute 
appendicitis and work inhibition share 
certain characteristics as illnesses, and 
methods of treating them have common 
features, this does not imply that surgeons 
should do psychotherapy or psychothera- 
pists remove appendices. 

I should now like to consider three 
aspects of psychotherapy as a means of 
influencing a patient's judgments about 
himself in the direction of health: the 
therapist as a socially designated healer, 
the patient's and therapist's expectations 
about treatment, and some effects of the 
therapist's interpretations on the patient's 
emotions. 

The therapist's social role has two 



therapeutic aspects: it enhances the pa- 
tient's expectation of help and conveys to 
him acceptance by his group. The power 
of the former factor, though well known, 
is greater than one likes to admit. For 
example, the prestigeful role of the physi- 
cian in Western society until recently was 
essentially the only source of his healing 
power, since the pharmacopoeia contained 
almost nothing but noxious or harmless 
substances. Yet through his ability to 
arouse the patient's expectation of cure 
by diagnosing his illness and prescribing 
a "remedy" he was able to heal patients 
often enough (with the tendency to spon- 
taneous recovery also working in his 
favor) to maintain his reputation through 
the ages (Shapiro, I960). 

In group methods of treatment, the 
therapist's function as intermediary be- 
tween the patient and the group is obvi- 
ous. But even in dyadic treatments some 
of his efficacy lies in the fact that his 
attitudes by implication reflect the atti- 
tudes of the culture or, in societies as 
diversified as ours, perhaps only a sub- 
culture, which is important to the patient 
because he belongs to it or aspires to do 
so. Insofar as illness involves a sense of 
alienation from others and this is par- 
ticularly true of mental illness the thera- 
pist's acceptance of the patient may serve 
as a powerful symbol of the concern of 
the group for his welfare, with markedly 
beneficial effects on his morale. 

Thus it is not surprising that the heal- 
ing role itself may be therapeutic, regard- 
less of who fills it. Many healing rituals, 
especially in religious settings, are medi- 
ated by persons, to be sure, but do not 
depend for their effectiveness on any par- 
ticular individual. Priests at Lourdes are 
interchangeable as, within limits, are 
medicine men in primitive societies and 
physicians and psychotherapists in West- 
ern ones. In a study of placebo responsiv- 
ity with outpatients we assigned patients 
serially to two members of the Phipps 
resident staff who represented the avail- 
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able extremes in personality. One was 
forceful, lively, and vigorous, the other 
quiet and shy. Their differences were suffi- 
ciently clear-cut to show up on several 
personality tests. Yet their patients showed 
precisely the same degree of symptom 
relief from placebo. Perhaps they did not 
differ sufficiently in personality they had, 
after all, both been accepted as members 
of the Phipps residency staff, and one does 
not know how much selectivity is exer- 
cised in this choice. A more plausible 
assumption is that placebo reactivity de- 
pends primarily on the patient's ability to 
accept the doctor in his role as healer, and 
the fact that both these physicians were 
identified as Hopkins doctors and gave 
the medication in the Hopkins Hospital 
overshadowed the possible effects of any 
personality differences. 

In emphasizing the healing potential 
of the physician's role and setting, I do 
not wish to minimize the importance of 
his personal qualities. Some physicians 
have more healing power than others of 
equal technical competence. Accounts in 
the anthropological literature suggest that 
this may also be true of medicine men 
(Levi-Strauss, 1958). Finally, we must 
not avert our gaze from certain religious 
figures and nonreligious healers who seem 
to exude some sort of healing force. This 
personal attribute has not been adequately 
conceptualized or studied, forcing one to 
take refuge in such unsatisfactory descrip- 
tive terms as personal magnetism or 
charisma. 

The importance of personal qualities 
of treatment personnel was recently illus- 
trated in an unusually specific fashion by 
a patient who had come out of a catatonic- 
like condition in which she was mute and 
had to be tube-fed. She described vividly 
how for some days after emerging she 
would at times begin to feel frightened, 
things would become unreal, and she 
would feel herself sliding back into her 
catatonic state. She singled out two at- 
tendants on the ward, one male, one 



female, who could dissolve this feeling by 
speaking with her, while others frightened 
her or had no effect one way or the other. 

After assigning some healing power to 
the therapist's social role and some to gen- 
eral qualities of his personality, is any- 
thing left for his capacity to form a highly 
individualized, empathic relationship with 
a particular patient? I believe that this 
may be crucial for patients who have diffi- 
culty perceiving the therapist as poten- 
tially helpful. The largest category of these 
patients is the schizophrenics, whose mas- 
sive and generalized distrust precludes 
their acceptance of a therapist as helpful 
simply on the basis of his socially defined 
role or personal magnetism. Their trust 
can often only be won by a highly per- 
ceptive and skillful therapist over a long 
period of time. 

These considerations suggest that the 
ability of patient and therapist to meet 
each other's expectations is an important 
component of healing. There is some ex- 
perimental evidence that a patient's failure 
to remain in treatment, or to improve, 
may be related to failure to establish this 
mutuality of expectation. 

With respect to remaining in treat- 
ment, this hypothesis accounts for the 
well-known tendency of lower-class pa- 
tients to drop out or be rejected by the 
therapist more often than those of 
higher classes. The latter come to therapy 
knowing how to present their difficulties 
in terms which permit them and the 
therapist to perceive them as amenable to 
psychotherapy. Lower-class patients, lack- 
ing this prior knowledge, tend to cast the 
psychotherapist in the traditional medical 
role with which they are familiar, and 
present their complaints accordingly. This 
impedes the therapist from playing his 
accustomed role, and the relationship, 
lacking a basis of shared expectations, 
collapses. 

Pertinent in this connection is a study 
of formerly hospitalized schizophrenics 
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which showed that remaining in treat- 
ment was not directly related to the thera- 
pist's warmth, but to whether this attitude 
was congruent with the patient's view of 
his illness. The psychiatrists were rated 
on a "relationship index" determined by 
the extent to which their notes described 
the patient's interpersonal behavior and 
his subjective feelings; the patients, in 
terms of whether they denied or accepted 
their illnesses. The deniers were much 
more likely to drop out of treatment if 
faced with a doctor who scored high on 
the relationship index than with one who 
scored low. The acceptors showed the re- 
verse tendency. It seems as if the deniers 
were trying to communicate that they did 
not wish the physician to poke around in 
their personal affairs. If he did not do so, 
they came back; if he persisted in trying 
to be "therapeutic," they left (Freedman 
etal, 1958). 

Failure to establish mutuality of expec- 
tation seems related not only to termina- 
tion of therapy but to failure to improve. 
When the patients in the Phipps out- 
patient study were dichotomized into 
most and least improved on the basis of 
combined change in discomfort and in- 
effectiveness at the end of five years, it 
was found that the latter did much more 
shopping around than the former. All five 
patients who reported trying every type 
of treatment resource were among the 
least improved. This appeared related to 
their perception of their illness. Most and 
least improved were checked with equal 
frequency for illnesses in the follow-up 
period which were unequivocally psychi- 
atric or unequivocally medical in the eyes 
of the raters. However, the least improved 
were scored half again as often for illness 
which they saw as medical but the raters 
believed was primarily psychological, and 
11 times as often for illnesses which the 
raters were unable to categorize because 
they were so inadequately described. The 
least improved either conceptualized their 
complaints in a way which brought them 



to the wrong treatment resource they 
went to medical practitioners for psycho- 
logically based disorders or were unable 
to define them clearly at all. 

If the patient's failure to form an ex- 
pectation of improvement is related to his 
failure to improve, the converse should 
also hold. That is, expectation of improve- 
ment should be correlated with actual im- 
provement. Several experimental studies 
offer tenuous support for this hypothesis. 
In a preliminary study at Phipps, out- 
patients were given a symptom check list 
immediately after they registered. They 
were first asked to score themselves as 
they felt at the moment, and then how 
they expected to feel in six months. After 
the initial diagnostic interview by a med- 
ical student, they were asked to score 
themselves again as to how they felt. Con- 
firming similar results found by others 
(Goldstein & Shipman, 1961), a positive 
correlation was obtained between the 
amount of symptom reduction they antici- 
pated at six months and the amount they 
reported at the end of the initial inter- 
view (Friedman, 1961). A related finding 
obtained by others was that placebo re- 
sponsiveness was a remarkably good 
prognosticator of whether previously hos- 
pitalized schizophrenic patients would 
stay out of the hospital. Of those who had 
to be rehospitalized within thirty days, 
not one responded favorably to placebo, 
while four-fifths of those who remained 
well enough to stay out of the hospital 
had shown a favorable response. Appar- 
ently placebo responsiveness was an indi- 
cator of their ability to accept the doctor 
as a source of help perhaps even an 
indirect measure of their capacity to trust 
their fellow man and this was related to 
their ability to cope with life outside a 
hospital (Hankoff et aL, 1958). 

From the therapist's side, there is a bit 
of evidence that his expectation of being 
able to help the patient may also be re- 
lated to therapeutic benefit. In one study, 
medical student therapists were asked to 
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rate how much improvement they ex- 
pected to see in their patients, at the start 
of therapy. After 15 sessions, patients 
were dichotomi2ed into those who per- 
ceived their problems as improving and 
those who felt their problems had intensi- 
fied. Therapists of those patients who 
reported improvement had expected sig- 
nificantly more improvement than thera- 
pists of patients who felt they got worse 
(Goldstein, I960). Another study found 
that experienced therapists expected their 
patients to improve more than inexperi- 
enced ones, and brought about more posi- 
tive change (Chance, 1959). The results 
of both these studies might be accounted 
for in several different ways. The first may 
simply reflect accuracy of prognosis, the 
second the beneficial effects of experience. 
Nevertheless, in conjunction with other 
data, they may be tentatively regarded as 
confirmatory evidence that the therapist's 
expectations may affect his results and are 
related to his perception of the patient. 
How the therapist's expectations are trans- 
muted into therapeutic efficacy remains 
to be determined. One possibility is that 
therapists, being human, are more inclined 
to like patients they think they can help, 
and this must affect the amount of effort 
they put out (Strupp, I960). 

Implicit in much of what has been said 
so far is that the patient's emotional state 
is related to his responsiveness to psycho- 
therapy. One property of the patient re- 
lated to capacity to improve is his emo- 
tional reactivity. The despair of the 
psychotherapist is the apathetic patient or 
the one who manages to prevent emo- 
tional arousal by intellectualizing. Certain 
patterns of responsiveness of blood pres- 
sure to injections of adrenalin and 
mediolyl seem to be related to capacity to 
respond not only to electroshock therapy, 
for which this was originally proposed as 
a prognostic test ( Funkenstein, Green- 
blatt, & Solomon, 1948), but to psycho- 
therapy as well (Brothers & Bennett, 
1954) . Pursuit of this lead, however, soon 



reveals that the capacity for response de- 
pends not only on the properties of the 
patient's nervous system, but on how he 
perceives his environment. One series of 
chronically psychiatrically ill men, whose 
condition was characterized by "dull de- 
jection and bland hopelessness," and who 
therefore might be thought to be unre- 
sponsive, showed marked behavioral signs 
of affect and changes in heart rate and 
blood corticoids in response to certain 
highly specific stresses that threatened 
their dependent status. The investigators 
concluded that the patients' apparent un- 
responsiveness, which undoubtedly was 
related to the chronicity of their condi- 
tion, was a reflection of their ability to 
shut out or evade stressful stimuli (Oken 
et al., I960). Common stimuli for sick 
people are other persons, including thera- 
pists. In our follow-up studies of psychi- 
atric outpatients we were impressed with 
the amount of help they sought from 
physicians, psychologists, ministers, and 
others designated as sources of help by our 
society. All went at least once to such a 
person during the four-and-one-half-year 
follow-up period, and two-thirds went to 
more than one type of socially defined 
help-giver. Thus from the patient's stand- 
point, his capacity for improvement may 
lie in part in this ability to be emotionally 
aroused in certain ways by the treatments 
he receives. 

Many of the emotional states stirred up 
by psychotherapy would be expected to 
have therapeutic effects. These include 
hope, friendship, love, and so on. Psycho- 
therapeutic methods, however, character- 
istically also elicit emotions which appear 
to be therapeutically irrelevant or actually 
damaging. A pilgrimage to Lourdes, for 
example, may entail an arduous journey 
and exhausting participation in the activi- 
ties at the shrine, culminating in immer- 
sion in an icy spring. In directive psycho- 
therapy the patient may be pressured to 
go into situations or attempt activities 
which make him anxious. Evocative treat- 
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merit may mobilize feelings of guilt, 
anxiety, rage, or frustration. Therapy 
groups may stir intense antagonisms as 
patients clash with others of different 
backgrounds or outlook, or contend for 
the therapist's attention, or become in- 
volved in multiple mirror and transference 
reactions. 

This leads to the question, why do the 
same emotions which are neutral or de- 
structive in a nontherapeutic context, such 
as suffering, guilt, or anxiety, contribute 
to the healing power of therapy? The 
reason is, I believe and this brings me to 
the final consideration that all psycho- 
therapeutic activities have a cognitive 
component which restructures the pa- 
tient's perceptions so that the same feel- 
ings which formerly indicated despair or 
anxiety now convey a message of hope. 

A hint as to the mechanism by which 
this occurs is given by an experiment 
which demonstrates with considerable 
probability that if a person has a feeling 
which he cannot evaluate he interprets it 
in terms of cognitions offered by his en- 
vironment. The basic experiment con- 
sisted of injecting naive subjects with 
adrenalin. In one experimental condition 
they were told exactly what sensations 
they would feel; that is, that they would 
experience mild heart palpitations, sweat- 
ing of the palms, and trembling. In others 
they were either told nothing or misin- 
formed, so that they had no adequate ex- 
planation for the sensation of internal 
unrest produced by the injection. A stooge 
entered the room while they were experi- 
encing the effects of the drug and behaved 
either in an amusing or an anger-pro- 
ducing fashion, and the subject's behavior 
was rated by a concealed observer. After 
this, subjects' self-ratings were obtained 
on scales of happiness and anger. Those 
who had been given an adequate explana- 
tion for their feelings reported no emo- 
tion and showed none in the test situa- 
tions. Those who had no such explanation 
acted happy in the amusing situation and 



angry in the anger-producing one, and the 
former reported much more subjective 
happiness than the latter. They interpreted 
the internal sensations produced by the 
adrenalin in terms of cognitions provided 
by the situation (Schachter & Singer, 1961). 

These findings may be relevant to the 
ability of psychotherapeutic situations to 
transmute destructive emotions into help- 
ful ones through providing a certain gen- 
eral context of healing. They also suggest 
a source for the therapeutic power of the 
therapist's interpretations. One may sur- 
mise that most patients have no adequate 
explanation of their distressing feelings, 
or have an explanation which is obviously 
wrong, or which aggravates the feelings. 
A patient with diffuse anxiety would 
represent the first category; a phobic pa- 
tient who knows his fears cannot really 
be caused by the objects to which they are 
attached, might represent the second. The 
third would be the patient who interprets 
his anxiety or depression as a sign of im- 
pending insanity. The therapist supplies 
an explanation for the feelings which the 
patient can accept as valid and this be- 
comes the way he actually feels. For ex- 
ample, he may discover that diffuse 
anxiety is really repressed rage at his 
mother, or the phobia an expression of 
fear of his own destructive impulses. The 
therapist may convey the explanation 
directly or, through subtle cues, bring the 
patient to the point of verbalizing it for 
himself. The new cognition is usually part 
of a self-consistent conceptual scheme, 
which further helps the patient to organ- 
ize his feelings. These cognitions also sug- 
gest certain lines of behavior which tend 
to lead to improved relationships with 
others. This further diminishes the feel- 
ings, and so the patient gets better. 

There is no independent, objective 
criterion for the truth of any interpreta- 
tion in psychotherapy. As is well known, 
therapists of different schools, or even of 
the same school, may vigorously defend 
widely differing interpretations of the 
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same material, and each is unable to con- 
vince the others that his is the correct one. 
The patient's acceptance of the therapist's 
interpretations, therefore, is probably 
largely determined by their plausibility in 
the light of the material and the prestige 
of the influencer (Kelman, 1958). In this 
sense the observation may be justified that 
the therapeutic effect of an interpretation 
depends not on its truth, but on whether 
both therapist and patient believe it to be 
true (Reid & Finesinger, 1952). 

Recently a patient after a single inter- 
view experienced one of those rare miracle 
cures which are so puzzling and grati- 
fying. As it seemed as if something of the 
sort I have just outlined accounts for the 
successful outcome, I should like to con- 
clude by presenting the case for your con- 
sideration. She is the wife of a struggling 
young lawyer, who came to see me re- 
luctantly following a particularly stormy 
bout of depression and anger, at the in- 
sistence of her husband, in whose eyes, 
incidentally, I have high prestige. She had 
had episodes of depression and preoccupa- 
tion at one- or two-week intervals since 
shortly before her marriage, which was of 
some five years' duration. Following the 
birth of a daughter a few months before 
coming for treatment, she was determined 
to be a perfect mother, and developed ex- 
treme irritability, often culminating in 
violent outbreaks connected with fears 
that she was not handling the child ex- 
actly right. She feared she would fail the 
child as her mother had failed her. The 
intensity of her feelings played into her 
fear of impending insanity. 

A review of her past history revealed 
that her mother was away much of the 
time in her infancy and vanished for 
good and all when she was about three. 
Her few memories of her mother were 
scenes of tender care. The father soon re- 
married and shortly thereafter went over- 
seas in the armed forces for a year and a 
half. During this period the patient de- 
scribed herself as a crybaby. After the 



father's return she became apparently 
happy and carefree until at the age of 14 
she discovered some of her mother's 
letters and a newspaper clipping in the 
attic which seemed to imply that she had 
been mentally ill and had suicided. This 
precipitated a new period of brooding 
and irritability. She was afraid to tell her 
father of her discovery lest she hurt his 
feelings. She angrily withdrew from him, 
and began to fantasy about whether her 
mother had committed suicide, whether 
her father was somehow responsible 
through his insensitivity, and whether she 
too would suicide. Again these feelings 
lifted apparently spontaneously after a 
year or so, and she became her former 
self until late in her courtship. As she was 
Jewish and her fiance Protestant, both 
families opposed the marriage and this led 
to tension between the engaged couple, 
which seemed to have something to do 
with the recurrence of her depression. A 
final bit of information was that in the 
interview she showed obvious conflict 
about whether to confide in me. 

Before indicating the interpretation I 
offered, let me remind you that this ma- 
terial has been selected out of the patient's 
total productions because it supports it. 
Another therapist might conceivably 
select equally convincing supportive ma- 
terial for another interpretation. That is 
to say, the plausibility of what follows 
may be somewhat spurious. I suggested 
to the patient that, having been twice 
abandoned by people on whom she felt 
dependent, her mother and her father, she 
was afraid to put her trust in anyone, in- 
cluding her husband, and that she was 
showing this attitude in the interview 
itself. The earlier periods of depression I 
attributed to the original desertions by 
her mother and father and their reactiva- 
tion by discovery of the letter. 

As she said later, this interpretation 
went off like a gong. She confirmed her 
acceptance of it in the next interview by 
spontaneously attributing the recurrence 
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of her depression and irritability during 
the courtship to her fiance's periodic 
threats to terminate the engagement be- 
cause of the family opposition, which had 
reactivated the feelings of desertion by 
her mother and father. In the three 
months since the initial interview, during 
which she was seen only twice, she has 
continued essentially symptom-free. For 
the first time she has fully accepted the 
fact that her mother suicided. Previously 
she had always toyed with possible alter- 
native explanations. She feels more 
friendly to her father, and he seems to act 
less reserved towards her. She no longer 
tries to be a perfect housewife and mother. 
For example, she has been able to admit 
to her husband sometimes that she is too 
tired to cook. Above all, she confides her 
feelings to him and has realized, to her 
astonishment, that in her brooding periods 
she thought she was speaking her feelings 
aloud but was actually reciting them to 
herself. 

A plausible explanation of what hap- 
pened might be the following. The pa- 
tient's feelings were inexplicable to her. 
Insofar as she had an explanation for 
them, namely, that she was going crazy 
like her mother, this aggravated them. She 
could not share these feelings with any- 
one, which isolated her. An additional 
source of stress was her perfectionism, 
which could be viewed as an effort to re- 
assure herself that she was not incom- 
petent like her mother and did not have 
to depend on anyone. 

On the basis of the information she 
supplied, plus her behavior in the inter- 
view, I offered an explanation of her feel- 
ings which was plausible and which was 
the more acceptable because of my high 
prestige in her eyes. My interpretation 
enabled her to relabel her feelings as fears 
of again being abandoned by someone on 
whom she depended her husband. The 
obvious implication was that the best way 
to overcome this fear was not to prove to 
herself that she didn't need him but to 



take him into her confidence. Fortunately 
he was able to respond by offering support 
and encouragement, dissolving the barrier 
between them and reinforcing the new 
behavior. 

This case, then, illustrates how a new 
cognition offered by the therapist can 
directly produce a change of feeling which 
instigates behavior re-establishing the pa- 
tient's solidarity with a person who mat- 
ters to her. 

To sum up, this review suggests that 
the patient's potentiality for improvement 
depends in part on his emotional arousal 
in the context of his perception of the 
therapist and his therapeutic method as 
potentially beneficial. This perception de- 
pends largely on the therapist's social role 
enhanced sometimes by indefinable per- 
sonal qualities. From the standpoint of 
arousing expectation of help, the thera- 
pist's warm, nonjudgmental attitude and 
his sensitive awareness of the patient's 
problems may be important only with 
profoundly mistrustful patients who are 
not prepared to accept him at face value 
as a healer. 

The healing potential of any form of 
treatment depends in part on congruence 
of expectations of patient and therapist. 
Their failure to reach a consensus about 
what each expects of the other seems to 
be a major obstacle to a successful out- 
come. The importance of consensus is 
often overlooked because it can be taken 
for granted with the clientele of many 
psychotherapists. 

Finally, cognitive insights can influence 
behavior not only through the familiar 
processes of learning, but through capital- 
izing on the powerful drive to evaluate 
one's own emotional state in terms of en- 
vironmental clues. This seems related to 
the therapeutic effect of apparently de- 
structive emotions when aroused in a 
healing context, and to the ability of the 
therapist's formulations to directly modify 
the patient's feelings. 
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I. 

RESEARCH PROBLEMS RELATING TO THE PSYCHOTHERAPIST'S 
CONTRIBUTION TO THE TREATMENT PROCESS 



The Psychotherapist's Contribution to the 

Patient's Treatment Career 

DANIEL J. LEVINSON, PH.D. 



The official title of this section of our 
conference is "Research Problems Relat- 
ing to the Psychotherapist's Contribution 
to the Treatment Process." I am not sure 
how much consensus there is concerning 
the meaning of the term "treatment 
process." To me, this term refers to the 
concrete goings-on between therapist and 
patient: the evolving course of their nego- 
tiations, exchanges, and relationship dur- 
ing their work together. The treatment 
process, in this sense, is but one aspect of 
the total phenomenon of "treatment." 
Another aspect is outcome that is to say, 
the degree and kind of change in the 
patient's personality and life adjustment. 
There are other aspects as well. I assume 
that it is legitimate and of general inter- 
est here to consider the therapist's con- 
tribution to various aspects of treatment. 

If the above reasoning is correct, then 
we need a broader and analytically more 
useful title for our present universe of 
discourse. To my mind, the term that 
embraces most adequately the range of 
phenomena and the kinds of analysis with 
which we are concerned is "the patient's 
treatment career." This approach has most 
recently been elaborated by Goffman 
(1959). My own concern, at any rate, is 



with various stages and aspects of this 
career, and with the therapist's influence 
therein. 

Conceiving of the problem in this way 
has two specific advantages. First, it con- 
nects our work on treatment with a 
broader theory and investigation concern- 
ing careers and social roles of various 
kinds; for example, the career of student 
in a college, or that of criminal in a 
prison. Of particular relevance here are 
various "educational" and "correctional" 
systems within which a trained profes- 
sional staff attempts to induce psycho- 
logical change in successive generations 
of students or other "inmates." Studies of 
careers in these several settings may be 
expected to be mutually illuminating 
(Cohen, 1961; Stern, Stein, & Bloom, 
1956; Holt & luborsky, 1958). 

A second advantage of the notion of 
career is that it points to a number of 
areas of analysis which might otherwise 
be overlooked. It brings to bear socio- 
logical and sociopsychological perspec- 
tives in addition to a purely clinical one. 
The notion of career serves to emphasize 
that treatment usually takes place within 
an organized social setting such as a clinic 
or hospital; that becoming a "patient" is 
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not a simple act but represents a personal 
and social achievement by a mentally ill 
person; that treatment involves not only 
an intimate personal relationship between 
therapist and patient, but also a complex 
set of formal and informal contractual 
arrangements; and so on (Pine & Levin- 
son, 1961). A broad view of the treat- 
ment career also leads, as I hope to indi- 
cate below, to a more complex view of the 
forms of influence exerted by the therapist 
and others. 

My aims here are as follows: (a) to 
delineate briefly the major issues or theo- 
retical domains within this total area of 
inquiry; (b) to indicate the range and 
types of research problems, including 
some which have until now been neg- 
lected; and (c) to give a brief account of 
relevant research in which my colleagues 
and I have been engaged. Let us turn now 
to the first of these. 

MAJOR ISSUES OR ANALYTIC DOMAINS 

The recent proliferation of research on 
psychotherapy has been characterized 
above all by its variousness. Investigators 
have focused on diverse aspects of psycho- 
therapy. They have dealt with a number 
of dependent variables and have explored 
the possible effects of a number of deter- 
minants. They have used a variety of ex- 
perimental, observational, rating, and 
"testing" methodologies. They have been 
guided by a variety of theoretical ap- 
proaches Rogerian, Freudian, Skinner- 
ian, Parsonian, transactional, and many 
more. This abundance is in keeping with 
the times, and I imagine that few of us 
would want things otherwise. It is well 
represented in our conference, which will 
be enriched, if also made more compli- 
cated, by the widely representative char- 
acter of its membership. 

However, if we are to forego theoretical 
unity, we must at least have a common 
framework on which to hang our differ- 
ences. I should like to offer an outline of 



such a framework It is stated in "theo- 
retically neutral" terms, to use Koch's apt 
phrase. "Theoretically neutral" does not 
mean "atheoretical." Rather, the frame- 
work is theoretically encompassing in the 
sense that it deals with issues which are 
relevant to various theoretical approaches. 
To the extent that it does in fact take into 
account the events and variables dealt 
with in the diverse studies, it may serve 
to sharpen our view of the ways in which 
these studies overlap, converge, comple- 
ment each other, and stand in direct op- 
position. 

I shall propose seven major domains or 
classes of variables and events. Our vari- 
ous theories and empirical investigations 
deal with single domains or, more com- 
monly, with relationships between two 
or three domains. For present purposes, 
it must suffice merely to name and briefly 
identify each domain. 

1. Relatively Stable Personal-Social Char- 
acteristics of the Therapist 

I refer here to characteristics that the 
therapist brings with him, within himself, 
to the therapeutic situation, and that are 
"therapeutically relevant" in the sense that 
they operate as significant determinants of 
his dealings with the patient, and of his 
therapeutic effectiveness. All sorts of vari- 
ables are of potential interest. For ex- 
ample: 

(a) At the most general level, the 
"school" of personality theory and of 
therapeutic technique to which he nomi- 
nally subscribes. 

(b) At a more individualized level, the 
therapist's conception of the patient, of 
treatment, and of his own role as thera- 
pist. What kind of "therapeutic contract" 
does he prefer to establish? What is his 
conception of the "good" and the "bad" 
patient? What is his conception of the 
"mentally well" person, and what kinds of 
treatment goals does he set? What are his 
preferred modes of participation in the 
therapeutic relationship? 
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(c) The therapist's character traits, 
values, and affective qualities. Of interest 
here are such variables as emotional 
warmth, capacity for empathic relation- 
ship, obsessiveness, impulsiveness, authori- 
tarianism, tolerance for various kinds of 
value-violating behavior, values relating 
to achievement, creativity, sensuality, 
work, honor, and the like. An example is 
the work of Betz and Whitehorn (1956) 
on "A" vs. "B" personality types among 
therapists, in relation to therapeutic suc- 
cess with schizophrenic patients. 

(d) The therapist's psychosocial char- 
acteristics: class origin and mobility, 
ethnicity and ethnic identity, marginality, 
religion, age, sex, political outlook, and 
the like. Recent evidence (e.g., Rollings- 
head & Redlich, 1958; Imber et al., 1956; 
Kahn, Pollack, & Fink, 1959; Gallagher, 
Levinson, & Erlich, 1957) on the treat- 
ment relevance of these characteristics in 
patients adds to our interest in exploring 
their relevance in therapists. 

2, Relatively Stable Personal-Social 
Characteristics of the Patient 

It seems reasonable to suppose that the 
above characteristics of the therapist will 
be activated differentially, and will have 
differential therapeutic effects, as a func- 
tion of the characteristics of the indi- 
vidual patient. In assessing the influence 
of the therapist on the course and out- 
come of psychotherapy, we must therefore 
take into account the kinds of patients 
involved. Indeed, a large part of the total 
effort in every clinic and hospital goes 
into the selection of patients for psycho- 
therapy. Since the supply of psychothera- 
pists is so small as compared to the num- 
ber of persons needing help, it becomes 
especially important to allocate it wisely 
to make it available to those most likely 
to profit from it. Establishing the patient's 
prognosis for response to psychotherapy 
is at least as important as diagnosing his 
psychopathology, and is considerably more 
difficult. Numerous suggestions have been 



made concerning the characteristics that 
make for favorable treatment outcome, 
but the research evidence thus far is 
meager (Knapp et al., I960; for a com- 
prehensive review, see Fulkerson & Barry, 
1961). 

From a purely clinical point of view, 
this is a problem in treatment prognosis. 
However, the problem can be formulated 
in more general theoretical terms. In this 
perspective, the patient's personal-social 
make-up just prior to the onset of his 
treatment career is seen as providing one 
set of determinants of the course and out- 
come of this career. His career develop- 
ment is also influenced by the nature of 
the treatment situation, which presents 
multiform demands and opportunities for 
work, learning, and personal growth, and 
by other determinants (see below). 

What characteristics of the patient are 
most likely to influence the course and 
outcome of his treatment career? Perhaps 
the greatest attention has been given thus 
far to diagnostic features, that is, to the 
nature and severity of his illness. It is 
often suggested, for example, that hys- 
terics do better in psychotherapy than 
obsessives. The research evidence to date, 
however, indicates that the relevance of 
diagnostic categories has been overrated 
in this as in many other types of predic- 
tion. 

In any case, numerous other character- 
istics must be considered in addition to 
those relating to pathology. In particular, 
the kinds of "therapist" variables noted 
in the first domain above may be of stra- 
tegic importance in the patient. We need 
to know more about the patient's concep- 
tion of mental illness, of his own diffi- 
culties, of treatment and his own role 
within it The person who finds psycho- 
therapy threatening or, worse, meaning- 
less, is not likely to seek it out, to accept 
it, or, should he take part, to confront the 
tasks it presents with serious commitment 
(Gallagher, 1958; Levinson, I960). Char- 
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acter traits, values, and affective qualities 
not ordinarily included in the formulation 
of the patient's psychopathology may 
crucially affect his participation in treat- 
ment. Finally, psychosocial characteristics 
relating to social class, ethnicity, age, re- 
ligion, and the like are coming to be 
recognized as therapeuticaily relevant. 

3. Characteristics of the Patient-Therapist 

Pair 

The foregoing Domains 1 and 2 refer 
to characteristics of the therapist and of 
the patient taken singly. For many pur- 
poses (such as the prediction of out- 
come) , however, it may be more useful to 
consider the match between therapist and 
patient, that is, the ways in which they are 
similar and dissimilar in enduring per- 
sonal-social features of the kind previously 
discussed. Similarities of certain kinds 
may facilitate the formation of a thera- 
peutic relationship and the carrying 
through of therapeutic work. Other simi- 
larities may become sources of impasse, 
as when the patient presents problems that 
the therapist has not resolved within his 
own personality. Similarly, treatment may 
be helped or hindered by differences in 
pathology, in character traits, in values 
and life goals, in age, intelligence, and 
social origins. 

A number of interesting questions are 
just beginning to be studied. To what ex- 
tent is there mutual selection by simi- 
larity? It would appear that many patients 
in psychotherapy and analysis strongly re- 
semble their therapists in education, 
values, professional interests, treatment 
ideology, and the like. (Less is known 
about the clientele of more somatically 
oriented therapists.) Psychotherapists tend 
to prefer patients who are. like them- 
selves, "psychological-minded" (Sharaf & 
Levinson, 1957). At the same time, such 
patients often use their self -probing skills 
in the service of defense, and it may well 
be that patients who initially find the 
therapist more of an alien figure can bene- 
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fit more once they come to identify with 
him and gain a new perspective on their 
lives (Rosenthal, 1955). I shall later re- 
turn to this and related questions. 

4. Stages in the treatment Career 

We have been considering, in the first 
three domains, relatively enduring char- 
acteristics that patient and therapist bring 
to the treatment situation. We turn now 
to the treatment career proper, to the 
arrangements, conditions, negotiations, 
and evolving relationships of which it is 
comprised. 

It is useful first to distinguish several 
stages in treatment, especially since studies 
differ in their focus on one or another 
stage or on the long-term sequence. The 
division of a total "flow" into successive 
stages is in large part arbitrary and will 
vary according to the nature of the therapy 
and the purposes of the research. For pres- 
ent purposes, it is probably sufficient to 
distinguish the following stages. 

(a) The candidacy stage. This is the 
period in which the ill person negotiates 
with a therapist (and, often, with other 
staff members at a clinic or hospital) over 
the possibility of becoming a patient in 
psychotherapy. Since this period occurs 
prior to the instigation of treatment, it is 
usually not considered to be an intrinsic 
part of the therapeutic enterprise. I would 
suggest, however, that it is in fact the first 
step in the patient's treatment career and 
that our analysis of psychotherapy ought 
properly to begin with it. For the candi- 
date who "passes" the admission require- 
ments and continues to the next stage, the 
events of the candidacy period may well 
be decisive in shaping the initial char- 
acter of the therapeutic relationship. 
Moreover, an adequate understanding of 
psychotherapy, and of the therapist's con- 
tribution to it, must take into account the 
selection process, and the differences be- 
tween the successful and the unsuccessful 
candidates. One of the major functions of 
the therapist is to decide which candidates 
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not to accept, and the problems involved 
here are of as great importance as those 
of the subsequent stages. 

In this stage, as in the others, we may 
focus variously on process, structure, or 
outcome. By process I refer to analyses of 
the stream of events: the temporal se- 
quence of negotiations, emotional ex- 
changes, transactions involving the pa- 
tient, the therapist, and, in a treatment 
facility, other staff members. The struc- 
tural features of a stage have to do with 
the more or less stable arrangements, 
"working conditions," and behavioral 
characteristics of the persons involved. 
Structural features of the candidacy period 
in a public clinic, for example, would 
ordinarily include the following: the re- 
quirement that the patients must demon- 
strate financial need; the condition of 
scarcity the supply of therapists is not 
equal to the demand for treatment, so 
that there is a long waiting list and needy 
candidates must be rejected; the use of 
certain diagnostic techniques; the fact that 
the staff hold certain conceptions of the 
"good" and the "bad" patient; and so on. 

The outcome of a stage refers to the 
ways in which its problematic features 
the initial aims and lie issues worked 
on have been resolved or left unchanged. 
In the case of the candidacy stage, the 
most dramatic consequence is of course 
whether the applicant has been accepted 
or rejected for the next stage, psycho- 
therapy proper. More refined outcome 
variables may also be investigated. For 
example, in many clinics the psychothera- 
pists are grouped according to degree of 
experience and professional background 
(e.g., psychiatrists, psychologists, social 
workers). Successful candidates are often 
allocated among the several staff group- 
ings according to a rationale that reflects 
assorted implicit assumptions and value 
judgments concerning the attributes of a 
good therapist. "Type of therapist re- 
ceived" may be a significant outcome 
variable in this stage (Schaffer & Myer, 



1954). The actual efficaq r of a given sys- 
tem of allocation is usually not scrutinized 
by the clinic staff. A more subtle aspect 
of outcome concerns the effect of the 
candidacy period on the patient's feelings 
toward therapy and toward his own ill- 
ness. In some cases, the selection process 
works in such a way as to facilitate the 
candidate's transition into patienthood. In 
other cases it serves to increase anxiety 
and defensiveness, hindering or prevent- 
ing the instigation of treatment. Thera- 
pists are inclined to attribute the candi- 
date's affective response primarily to his 
inner proclivities; in doing so, they may 
overlook some of the noxious or anxiety- 
arousing features of the selection situation. 
So much for the candidacy stage. With- 
in the course of psychotherapy, the follow- 
ing stages may be roughly distinguished. 

(b) The initial stage: forming a thera- 
peutic contract and a therapist-patient 
relationship. 

(c) The main stage of productive 
work on the patient's problems. 

(d) The Determination stage: ending 
the relationship and preparing for next 
steps in the patient's life. 

Consideration of stages b, c, and d 
would take us far beyond the scope of the 
present brief review. There are of course 
wide variations in the structure, process, 
and outcome of each stage. A given thera- 
pist may function well in one stage and 
poorly in another. Many patients leave or 
are ejected from the treatment at various 
points along the way. The determinants 
of variation are not well understood. In- 
deed, we have very little in the way of 
data describing the kinds of variation that 
occur. We need more substantial descrip- 
tive evidence on the nature and outcome 
of each stage before we can embark upon 
meaningful studies of the therapist's con- 
tribution to it. 

5. Over-all Treatment Outcome: In What 
Ways Has the Patient Changed? 
This is, clearly, the pay-off question in 
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psychotherapy. Despite all the controversy 
about the relative merits of psychotherapy 
(or various brands thereof), comparative 
research on the outcome of various forms 
of treatment is notable by its scarcity. 

In assessing treatment outcome, differ- 
ent investigators have been concerned 
with numerous forms of change in the 
patient. The variables have included 
symptom-reduction, improved social ad- 
justment, general "comfort" in living, in- 
creased self-esteem, and a host of more 
subtle but highly valued changes sub- 
sumed under such rubrics as "emotional 
growth," "self - realization/* and "ego 
strength." Data have been obtained from 
various sources the patient himself, the 
therapist, independent clinical observers 
and testers, family members, employers 
and by various techniques ranging from 
behavior observations to O sorts to global 
clinical judgments. However, single 
studies have for the most part utilized 
only a small portion of the total spectrum 
of variables and measuring techniques. It 
is to be hoped that more attention will in 
future be given to the systematic analysis 
of outcome and that more comprehensive 
assessment procedures will be used. 

6. The Institutional Setting of Treatment 
in Clinic or Hospital 

Psychotherapy is usually conceived of 
as a dyadic relationship located within the 
boundaries of the therapist's office. The 
"private practice" situation is thus taken 
as the prototype of treatment. The fact is, 
however, that most of the psychotherapy 
in this country is done in the clinic or in 
the hospital. The therapeutic work thus 
takes place within an institutional context 
that exerts manifold influences upon it. 
In the hospital, for example, the therapist 
is not merely an "auxiliary ego" or a "rein- 
forcing agent"; he is also an authoritative 
figure who plays an important part in 
determining the patient's movement 
through the hospital. In addition, other 
aspects of hospital life may crucially facili- 



tate or hinder the course of psychotherapy. 
Even in the clinic, the therapist-patient 
relationship is influenced by the therapy 
supervisor, by other staff members, and 
by clinic requirements and policies. Ex- 
cept for a few studies (such as the pio- 
neering work of Ekstein and Wallerstein, 
1958), the impact of institutional influ- 
ences upon psychotherapy has been vir- 
tually ignored. 

7. The Social Context of the Patient's Life 
I refer in particular to influences stem- 
ming from the patient's family, friends, 
work situation, and other sectors of the 
community that loom large in his life 
space. The importance of these influences 
has long been recognized in clinical work 
as witness the efforts of social workers, 
rehabilitation programs, and the like 
but it has by and large been overlooked 
in psychotherapy research. The patient's 
response within various stages of treat- 
ment, as well as the nature and stability 
of over-all treatment outcome, may be due 
as much to the stresses, supports, and re- 
sources in his social environment as to the 
psychotherapy itself. This is especially 
true in the treatment of children, and of 
adults with psychoses, borderline states, 
and character disorders. 

Summary 

My thesis, then, is that a truly compre- 
hensive theoretical analysis of psycho- 
therapy must encompass the seven do- 
mains noted above. How to conceptualize 
these domains, and how to investigate 
systematically the interrelationships with- 
in and among them are, I believe, the 
fundamental issues confronting us. 

By way of final summary, Figure 1 is a 
diagrammatic representation of the pro- 
posed model of the patient's treatment 
career. 

SOME RESEARCH PROBLEMS 

We turn now from the analytic do- 
mains to a consideration of various types 
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Figure 1 Diagrammatic representation of a proposed model of the patient's treatment career. 



of research problems, with emphasis upon 
the relevance of the therapist. 

One set of problems involves the deri- 
vation of significant events and variables. 
An example is the demonstration that the 
patient's social class position (Domain 2) 
is a widely significant variable in the sense 
that it is related to type of illness, treat- 
ment preference, place of hospitalization, 
treatment received, and the like. Findings 
of this kind indicate that class should be 
taken into account in further studies of 
all sorts. Similarly, evidence that the thera- 
pist often acts within the treatment proc- 
ess, so as to reinforce certain behaviors of 
the patient, leads us to further investiga- 
tion of the influence of type and frequency 
of reinforcement on the course and out- 
come of psychotherapy (see Krasner f s 
paper) . Dynamically oriented research ap- 
proaches would be greatly benefited by 
the derivation of theoretically relevant 
"therapist" variables (Domain 1) having 
demonstrable significance in predicting 
the patient's treatment fate. Our need is 
equally great with regard to meaningful 
"outcome" variables. 

There is a second line of work that may 
seem trivial in itself and yet is needed to 
provide a base for more complex analyses. 
I refer to simple, descriptive data on the 



relative frequency of various character- 
istics in various populations; e.g., on the 
personal and social characteristics of pa- 
tients in various treatment settings. Data 
recently gathered on the occupational and 
educational characteristics of patients in 
psychoanalysis offer useful leads for re- 
search on the possibilities and limitations 
of psychoanalytic treatment. Equally in- 
teresting leads for studying the role of the 
therapist in various types of psychotherapy 
might be found in data on the personal 
and social characteristics of therapists 
having various professional backgrounds 
and theoretical persuasions (Sharaf & 
Levinson, 1957; Klerman et al., I960). 

Another important type of research 
problem is the determination of relation- 
ships between variables in different ana- 
lytic domains. A central problem of this 
kind involves the correlates (predictors, 
determinants) of treatment outcome. If 
we represent the domains by the numbers 
used above, the paradigm here is: 5=f 
(1, 2, 3, 4, 6, 7). That is to say, variables 
in each of the other domains are possible 
predictors or determinants of final out- 
come. 

In this connection, we may point out 
various routes for study of the therapist's 
contribution to outcome. The route 
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through Domain 1 seeks to relate endur- 
ing characteristics of the therapist to his 
general efficacy in producing favorable 
treatment results. A second route, through 
Domain 3, is based on this question: Do 
certain kinds of initial "fit" (patterns of 
similarity and dissimilarity) between 
therapist and patient tend to increase the 
probability of treatment success? Again, 
we may work through Domain 4, asking: 
How is treatment outcome influenced by 
the therapist's modes of dealing (intellec- 
tually, emotionally, conatively) with vari- 
ous issues that arise in each stage of the 
patient's treatment career? I have in mind 
here such features of the therapist's func- 
tioning as the kinds of clarifications and 
interpretations he offers, the ways in 
which he balances neutrality and involve- 
ment, his firmness in setting limits, his 
sensitivity to the immediate emotional 
interchange between himself and the pa- 
tient, the treatment goals he sets, and so 
on. Finally, there are routes through Do- 
mains 6 and 7: The therapist may con- 
tribute to treatment outcome in part by 
the ways in which he intervenes, or fails 
to intervene, in the patient's institutional 
and community situation. To the extent 
that the therapist has the opportunity 
directly to exert control or indirectly to 
induce others to behave in certain ways 
toward the patient, the use he makes of 
this opportunity is an intrinsic aspect of 
his therapeutic role. 

The therapist contributes in equally 
multiple ways to the course and outcome 
of each stage within the treatment enter- 
prise. Ultimately, if we are to understand 
the therapist's contribution to treatment, 
we must follow all of the above routes and 
deal with the questions they raise. Viewed 
in this broad perspective, the present state 
of research seems primitive indeed. On 
this sobering note, I turn to a brief ac- 
count of our work in one sector of the 
terrain outlined above. 



ANALYSIS OF THE NATURE AND OUT- 
COME OF THE "CANDIDACY" STAGE 

It seems only natural, if we want to 
understand psychotherapy, to focus our 
investigations upon the psychotherapeutic 
process or upon the treatment careers of 
those ill persons who become patients. To 
do this, however, is to neglect some funda- 
mental problems, since a large proportion 
of the persons who seek treatment do not 
receive it. We need to know much more 
about the character of the candidacy 
period. What about the unsuccessful 
candidates those who seek to become 
patients but who, for various reasons, do 
not make the grade? How do they differ 
from those who succeed? What are the 
admission policies and selection proce- 
dures by which candidates are evaluated? 
What part does the therapist play in this 
initial stage of the would-be patient's 
career? 

I shall consider the candidacy period 
chiefly as it occurs in the mental hospital 
and psychiatric clinic. It is most amenable 
to study here, and my own work has been 
carried out in these settings. 

There is increasing evidence that, in 
most dinics, only a small percentage of 
the applicants are actually taken into 
psychotherapy. Within the "successful" 
group, moreover, a sizable attrition occurs 
during the first several weeks. I would 
venture the estimate that, on the average, 
not more than 20-30% of clinic appli- 
cants embark on a psychotherapy career 
of more than a few interviews. The 
paucity of even the most simple descrip- 
tive data bearing on this question is truly 
remarkable. The situation is more extreme 
in mental hospitals where, except for a 
very few in which virtually all patients 
receive psychotherapy, only small num- 
bers of patients receive more than routine 
care and drugs. 

One of our major research concerns is 
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with the determinants of outcome of the 
candidacy stage. On what bases are candi- 
dates evaluated and accepted or rejected? 
Two contrasting conceptions of the selec- 
tion process may be noted. 

1. One view, held by many psycho- 
therapists, is that the therapist selects 
patients largely on rational grounds, by 
an informed assessment of their ability to 
profit from this form of treatment. The 
candidate's fate is, from this point of view, 
essentially a matter of his own personality; 
treatment is something he earns through 
his own capacity and effort. Whether a 
candidate is selected for psychotherapy, 
and how well he does in it, depend 
upon his (dynamically based) readiness 
to do the work involved. Therapist and 
clinic are regarded as resources available 
to those who can genuinely make use of 
them. Two types of patient characteristics 
are given the greatest explicit attention in 
the selection process: first, diagnostic 
criteria relating to the nature and severity 
of psychopathology (e.g., hysterics may 
be considered better treatment bets than 
character disorders); and second, those 
relating to the patient's "motivation for 
therapy" his desire for inner change, his 
readiness to be a responsible agent in 
treatment, his capacity for introspection 
and self-examination, and the like (Lich- 
tenberg et aL, I960). 

Thus, in the above view, patients are 
selected by means of a relatively dispas- 
sionate, rational assessment of diagnostic 
and prognostic indications. This highly 
rationalistic conception is, of course, a 
part of the heritage that dynamic psychia- 
try and clinical psychology have accepted 
from traditional medicine. Unfortunately, 
we have as yet only the most meager basis 
for prognostic judgment, and selection is 
often as much a matter of the therapist's 
personality as of the patient's. All sorts of 
nonrational and irrational factors may in- 
fluence the selection of patients. We need 



to know much more, not only with regard 
to valid prognostic indicators, but also 
with regard to the total process of candi- 
date selection. 

2. A second approach, more commonly 
held by social scientists, regards psycho- 
therapy primarily as a commodity that the 
therapist or agency selectively allocates. 
The focus here is more on the staff than 
on the patient. Treatment is something 
the staff gives rather than something the 
patient earns. In exploring the criteria for 
allocation, social scientists have shifted 
the emphasis from the patient's psycho- 
dynamics to the social characteristics 
(notably class, ethnicity, mobility) of pa- 
tient and therapist. And, indeed, various 
studies have shown that psychotherapy is 
allocated in part along class and socio- 
cultural lines (e.g., Hollingshead & Red- 
lich, 1958). Some proponents of this view 
are inclined to blame the therapist, to 
imply that he is showing prejudice toward 
candidates whose class origin or religio- 
ethnic identity differs greatly from his 
own. This may well be true at times, but 
an approach that focuses narrowly on 
social characteristics is, in our opinion, as 
self-limiting as one dealing exclusively 
with psychodynamics. 

In the approach taken here, the two 
conceptions noted above are seen as com- 
plementary rather than as antithetical 
The acceptance or rejection of a candidate 
is an outcome of complex negotiations in 
which the candidate himself, the therapist, 
other clinic or hospital staff, the institu- 
tional setting, and influences from the 
patient's social world play important parts. 
We may limit ourselves to one or another 
of these in particular studies, but our theo- 
retical conception must be enlarged to 
encompass them all With regard to the 
therapist's contribution to candidate selec- 
tion, I would suggest that his decision to 
accept or reject the candidate is influenced 
to varying degrees by at least the follow- 
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ing: rational diagnostic and prognostic 
considerations, personal values, feelings 
toward the particular candidates as these 
develop over the course of their negotia- 
tions, stereotypes regarding "good" versus 
"poor" patients, ethnicity- and class-linked 
preferences and antipathies, and the like. 

We have carried out two large-scale 
studies of the inpatient population at the 
Massachusetts Mental Health Center 
(MMHC). The first was reported by 
Gallagher, Levinson, and Erlich (1957). 
The second has been described in part 
by Gallagher (1958) and by Levinson 
(I960); a more extensive manuscript is 
now in preparation. The MMHC is a 
short-term, active-treatment hospital. At 
the time of these studies, it housed 150 
patients, of whom approximately half re- 
ceived psychotherapy. Our research ques- 
tion: what are the differences, if any, be- 
tween the patients who receive psycho- 
therapy and those who do not? 

We found the following major corre- 
lates of psychotherapy receipt: (a) As in 
several other investigations, social class 
was shown to be a relevant factor. We 
used the Hollingshead Two-factor Index 
based on education and occupation. The 
higher the social class (especially educa- 
tion), the greater the probability of re- 
ceiving psychotherapy, (b) The patient's 
age is likewise a significant correlate: as 
age increases (especially as it exceeds 40), 
the chances for psychotherapy decrease. 
(c) Degree of authoritarianism, as meas- 
ured by the F Scale, also plays a part. The 
higher the F score, the lower the incidence 
of psychotherapy, (d) Finally, there is the 
influence of the patients orientation to- 
ward the hospital, toward various treat- 
ments, and toward himself as a patient. 
Patients who do not receive psychotherapy 
are more likely than the others to prefer a 
custodial, benignly autocratic hospital set- 
ting; they prefer somatic treatments; they 
make a sharp distinction between having 
a nervous breakdown and being really 



crazy, and place themselves in the former 
category; they regard themselves as pas- 
sive objects of treatment rather than as 
active participants in treatment. The fore- 
going orientation variables were measured 
by the CMI Scale (Gilbert & Levinson, 
1956) and by several newly developed 
scales dealing with patients' role-concep- 
tions. (For a more intensive exploration 
of these and other variables in a small 
sample of MMHC patients, see Ditmore, 
I960.) 

Taken alone, each of the measures in 
W, (b), (c} and (d) above yielded 
modest correlations of .30 to .40 with 
psychotherapy receipt. Combining several 
measures, we achieved a multiple corre- 
lation of about .70. It may also be of in- 
terest to note that the F Scale gave corre- 
lations in the range of .40 to .70 with the 
ideology and role-conception scales in 
(d) . We thus have a basis for conceptual- 
izing a broad syndrome comprising an 
autocratic, antipsychotherapeutic orienta- 
tion to patienthood within an authori- 
tarian personality structure. This syn- 
drome is somewhat more common among 
lower-class than among upper-dass pa- 
tients, to the extent of a correlation of 
.30 to .40. (All of these correlations are 
highly significant in the samples of 150 
and 100 patients, used in the two studies.) 

It would appear, then, that psycho- 
therapy receipt is related in a complex 
rather than a simple way to the patient's 
class, age, personality, and view of patient- 
hood. Our findings suggest that class is a 
relevant but by no means overriding influ- 
ence. Within each class level there are 
wide individual differences in personality 
and treatment orientation. While ac- 
knowledging the fact and the importance 
of class differences, let us be careful not 
to exaggerate these differences nor to de- 
velop overly homogenized images of "the" 
lower class (or other dass) patient. The 
conjoint investigation of dass (and other 
group membership), psychodynamics and 
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relatively conscious orientations regarding 
treatment will be more fruitful than the 
study of any of these domains by itself. 

To what extent do the above findings 
reflect social and psychological character- 
istics of the therapists (resident psychia- 
trist) at the MMHC? Although we have 
not pursued this question intensively, one 
bit of striking evidence may be noted: 
with regard to the characteristics that dif- 
ferentiate successful from unsuccessful 
candidates for psychotherapy, the residents 
typically resemble the former group. That 
is to say, the residents are largely of 
middle- or upper-class position, younger 
age, lower authoritarianism, and strongly 
oriented toward a "psychotherapeutic" 
conception of patienthood (Sharaf & 
Levinson, 1957). We thus propose a 
"homophilic" hypothesis; in selecting pa- 
tients for psychotherapy, the therapist 
tends to prefer candidates who resemble 
him in social background, outlook, and 
personality. He tends to reject candidates 
who differ markedly in most of these 
respects. 

The homophilic hypothesis is obviously 
in need of further refinement and em- 
pirical testing. With this and other pur- 
poses in mind, we are engaged in a more 
intensive exploration of the candidacy 
stage, this time in our outpatient clinic. 
Presentation of our work on this and 
other related studies is beyond the scope 
of the present paper. 
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The Therapist's Contribution to the 

Treatment Process: 
Beginnings and Vagaries of a Research Program 1 

HANS H. STRUPP, PH.D. 



It cannot be said that psychotherapists 
have generally welcomed the researcher- 
scientist with open arms. In fact, only the 
last decade has seen beginning changes 
which must be credited to the growing 
recognition that psychotherapy is not a 
congeries of magic operations, but an 
applied art perhaps even a scientific 
discipline and, as such, susceptible to 
study by the usual methods of science. 
This tolerance, however, was more likely 
to extend to research concerned with 
changes occurring in the patient as a 
result of psychotherapy rather than to re- 
search focused on the person of the thera- 
pist or on therapeutic techniques. The 
reluctance to subject psychotherapy to 
scientific scrutiny embodied reasonable as 
well as unreasonable elements. In particu- 
lar, the issue of invading the privacy of 
the therapeutic setting should not be 
lightly dismissed (for an eloquent state- 
ment of this view, see Szasz, 1959). Re- 
search concerned with the therapist's per- 
sonality and his therapeutic operations is 
of even more recent origin; indeed, we 
have scarcely done more than broken the 
ground for what in future years must 
become a major research effort. 

Because of the complex difficulties in- 
volved in studying the naturally occurring 
events in psychotherapy the First Con- 
ference on Research in Psychotherapy 
(Rubinstein & Parloff, 1959) has done 

1 This research was supported by Research 
Grant M-2171 (C2) of the National Institute 
of Mental Health, Public Health Service. Mem- 
bers of the project staff are Joan W. Jenkins, 
Ph.D., Martin S. Wallach, PhJX, and the 
author. 



much to highlight the problems investi- 
gators often have had recourse to experi- 
mental or quasi-experimental procedures 
which, hopefully, permit isolation of the 
process or processes one is interested in 
elucidating. Such procedures present prob- 
lems of their own, perhaps chiefly those 
of relevance or validity. I am referring to 
the question upon which I hope to elabo- 
rate later, namely: To what extent do 
findings generated by experimental pro- 
cedures contribute to and advance knowl- 
edge about psychotherapy and the psycho- 
therapeutic process? Needless to say, a 
technique or method may give the sem- 
blance of being relevant to psychotherapy, 
i.e., it may be face-valid, without possess- 
ing any intrinsic validity. 

In this paper I wish to discuss: (a) the 
evolution of a research method, together 
with a brief summary of the major results 
to which it has given rise; () a few con- 
siderations pertaining to the validity of the 
method, together with a critical appraisal 
of its potential promise; (<;) some selected 
problems of research strategy and method- 
ology, which have become dearer as the 
investigative work progressed; and (d) a 
brief description of current work by 
means of which we hope to further the 
objectives of our over-all program. 

DEVELOPMENT OF AN EXPERIMENTAL 
METHOD 

The experimental method, whose evolu- 
tion I will describe in the following pages, 
had its origin in a doctoral dissertation 
proposal (which, like many such ventures, 
was overly ambitious) . My interest, stimu- 
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lated by my teachers, Dr. E. Latin Phillips 
and Dr. Leon Salzman, involved the prob- 
lem of trying to make explicit the thera- 
pist's mental processes in formulating a 
communication (interpretation, question, 
etc.) addressed to a patient in psycho- 
therapy. Another source of inspiration 
was Glover's (1955, Pt. II) questionnaire 
survey of British psychoanalysts (con- 
ducted in the late 1930's), which perhaps 
was the first approximation to studying 
the actual operations of psychotherapists, 
as opposed to the prevalent practice of 
reporting, through clinical case descrip- 
tions or theoretical expositions, what 
transpired between therapist and patient. 
While Glover's survey was restricted to 
questions relating to practices in general, 
the data amply supported his original 
hunch, that the practices of even a rela- 
tively homogeneous group of psychothera- 
pists, all of whom had been trained in a 
single method (orthodox psychoanalysis), 
diverged considerably. In subsequent pub- 
lications Glover continued to draw atten- 
tion to individual differences among 
psychotherapists, advocating increasing 
"standardization" of the therapeutic in- 
strument, including the therapist. It was 
obvious to him, and it has since been in- 
creasingly recognized by others, that the 
person of the therapist, in conjunction 
with the techniques he uses, is an impor- 
tant source of variance, which may be a 
crucial factor in determining the course 
and outcome of psychotherapy. Thus, 
whether one is interested in the problem 
of therapeutic results, or in more process- 
oriented problems, it is important to focus 
on what the therapist actually does in 
psychotherapy. Parenthetically, it might 
be mentioned that the therapist's activities 
may be perceived and experienced very 
differently by himself, the patient, and by 
external observers. Because of the tradi- 
tional bias against introspection, far too 
little attention has been paid to the pa- 
tient's subjective experience in psycho- 
therapy, at least as far as "objective" re- 
search is concerned. 
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One approach to this research problem 
is to devise an experimental situation, 
resembling the therapeutic setting, to keep 
the stimulus invariant, and to study the 
responses of a group of therapists under 
these conditions. Whatever differences are 
observed must necessarily then be attribu- 
table to the therapist variable. Using such 
a technique, one might succeed in estab- 
lishing systematic relationships between 
the therapist's responses and such vari- 
ables as: level of experience, theoretical 
orientation, professional affiliation, atti- 
tudes, and the like. 

A procedure somewhat resembling the 
above paradigm was used in a study by 
Phillips and Agnew (1953) to study the 
degree to which reflection-of-feeling re- 
sponses were preferred to other kinds of 
therapeutic communications. Therapists 
were presented with a series of patient 
statements, each of which was followed 
by a set of five hypothetical therapist re- 
sponses from which a preferred comment 
was to be selected Among the shortcom- 
ings of this method were the lack of a 
meaningful context for patient statements, 
restrictions imposed upon the respondent 
to choose from a limited number of re- 
sponse alternatives, the assumption that 
the response alternatives were equally at- 
tractive in all respects save the reflection- 
of-feeling dimension, etc. In reflecting 
upon possible improvements, it seemed 
that a marked increase in realism could 
be achieved by letting the therapist formu- 
late his own response. 

The modified method (Strupp, 1955a, 
1955b, 1955c) consisted of a series of 27 
short paragraphs of patient statements 
culled from published therapeutic inter- 
views, and typed on individual cards. A 
minimum of background information 
about the patient preceded each statement. 
Included in the series, thought to repre- 
sent a fair cross section of verbalizations 
heard from neurotic patients hi early in- 
terviews, were a variety of complaints, 
statements by a borderline patient, suicide 
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threats, and communications illustrating 
blocking, requests for direct advice, hos- 
tility, and negativism. 

The procedure consisted in presenting 
therapists individually with the card 
series, asking them to assume that the 
patient statement occurred early in 
therapy, that the problem had come up 
for the first time, and that none of the 
patients were hospitalized. Respondents 
were free to formulate a comment to the 
patient in their own words; "silent" re- 
sponses were also considered acceptable. 

What kinds of data does an experi- 
mental situation of this kind generate, 
and what can be said about the relevance 
of such responses to the verbal behavior 
of the psychotherapist in a real therapeu- 
tic interview? Minimally, one may assert 
that responses collected from, say, 50 
psychotherapists represent the verbal be- 
havior of a particular group of persons 
with certain specialized training vis-a-vis 
a more or less arbitrary collection of 
verbal stimuli attributed to a variety of 
patients alleged to be in the beginning 
phase of psychotherapy. Whether and to 
what extent these responses correspond to 
what these therapists, individually or col- 
lectively, do in actual therapy remains an 
open question, but the assumption of con- 
gruence is implicit in the experimental 
procedure and represents its raison d'etre. 
Plainly, the purpose is to generalize, and 
the card series fulfills the function of a 
psychological test to sample a psycho- 
logical process under standardized condi- 
tions. 

At this point it may be apposite to 
point out some of the major difficulties 
obstructing the researcher's effort to study 
the behavior of a group of psychothera- 
pists under "natural" conditions. Logically 
and practically, it is patently impossible 
to hold constant the patient's behavior, 
and even one interviewer cannot perfectly 
replicate an interview with the same pa- 
tient. If, as is done in psychiatric board 



viewed successively by different candi- 
dates, one needs to make the assumption 
that the slate is wiped clean, as it were, 
before each interview. Strictly speaking, 
such an assumption is not warranted. If 
we use different patients for interview 
purposes we are only compounding the 
lack of comparability. 2 It becomes evident 
that, strictly speaking, it is impossible to 
study the interview behavior of two or 
more therapists under identical condi- 
tions, or of one therapist on two occasions. 
If, despite this state of affairs, one persists 
in the aim to obtain strictly comparable 
data on the performance of psychothera- 
pists, he is forced to accept compromises. 
Obviously, the closer the compromise 
situation remains to the criterion situa- 
tion, the better. In addition to the desid- 
eratum of the highest possible validity, 
however, one also strives to achieve re- 
search economy. It can be readily agreed 
that a card series, such as the one used in 
the above experiment, is highly econom- 
ical; its validity remains a question yet to 
be answered. The difficulty of specifying 
an "ultimate" criterion is that of deciding 
upon a truly representative measure of 
the therapist's interview behavior under 
standard conditions. Nevertheless, sam- 
ples of the therapist's behavior in differ- 
ent interview situations might come rea- 
sonably close, and in any case it should 
be kept in mind that the validity of the 
"model" is a strictly empirical question. 

It may be anticipated that the model 
is probably neither completely valid nor 
completely invalid. Validity is always 
relative. A more important question ap- 
pears to be: How relevant (valid) is the 
experimental situation to actual therapy, 
and can it be considered a fruitful device 
for generating hypotheses about the 



2 In passing only I wish to allude to the 
fallacies inherent in the frequent use of samples 
of "neurotic" or "schizophrenic" patients in 
many clinical investigations. Such labels all 
too often suggest information about the char- 
acteristics of a population, when in fact very 
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therapist's contribution to the treatment 
process? This question, it seems to me, 
is of the utmost importance for psycho- 
therapy research in general, because it 
highlights a crucial issue of research 
strategy: Shall we invest our energies in 
studying the naturally occurring events in 
psychotherapy? Or, alternatively, are ad- 
vances in research more likely to come 
from experimental (and often seemingly 
unrelated or only superficially related) 
analogies? Is it desirable and/or feasible 
to introduce experimentation into the 
therapeutic situation proper? Or, is 
laboratory experimentation to be pre- 
ferred? With reference to the experi- 
mental procedure used in a number of 
investigations, I shall enumerate some 
evidence which, I believe, has a bearing 
on its validity. Before doing so, however, 
it will be appropriate to describe certain 
refinements in the procedure which have 
evolved over the last five years. Paren- 
thetically, it may be noted that these modi- 
fications are not entirely uncorrekted with 
the project's increasing affluence through 
grant support. 

It is easy to see that the method of the 
card series was highly static, lacking in 
context, and, that it represented a greatly 
impoverished stimulus situation. In search 
for a better technique, the medium of the 
sound film suggested itself. 3 Lacking funds 
to produce a motion picture specifically 
designed for experimental purposes, adap- 
tations were made in an existing film, 
which had originally been produced by 
the Veterans Administration for training 
purposes. Designed to illustrate phobic 
mechanisms, it depicted an unrehearsed 
interview between a middle-aged neurotic 
man and a young resident in psychiatry. 
Essentially, the interviewer lets the patient 
tell his own story, frequently repeating 
a word or phrase, but otherwise focusing 
very little. At times, he seeks to elicit 
further information, which seems, how- 

3 To the best of my recollection, credit for 
this idea belongs to Leon Yochelson, M.D. 



ever, to have the effect of diverting the 
patient from an emotionally charged 
topic. 

To prepare the film for experimental 
purposes, the interview sequence was in- 
terrupted at a number of predetermined 
points, thus giving the prospective audi- 
ence of psychotherapists an opportunity 
to indicate what they would have done 
had they been the interviewer. Uniform 
tides ("What would you do?") were in- 
serted at 28 points in the 30-minute 
sequence, usually immediately preceding 
a comment by the film therapist. Through 
the use of this procedure, data were col- 
lected from over 200 therapists at several 
centers. (For a detailed description of the 
method, see Strupp, 1960a.) 

Since that time, in order to diversify 
the stimulus material and in order to cross 
check results obtained by means of the 
initial film, six motion picture sequences, 
each lasting approximately 15 minutes 
have been produced through motion pic- 
ture and television facilities at the Uni- 
versity of North Carolina, These films 
show different patients and therapists. All 
roles are portrayed by actors. The scripts, 
however, were derived from actual psychi- 
atric interviews. In all films the focus is 
almost exclusively on the patient, with the 
interviewer contributing only minimally. 
The intent is to avoid "competition" with 
the film therapist and thereby to facilitate 
"participation" by a vicarious interviewer, 
and to make the situation as realistic as 
possible. 4 

The most recent version of the experi- 
mental procedure consists in showing a 
film to a psychotherapist in a private set- 
ting, without other persons being present. 
The tides "What would you do?", each 

4 Dr. John Williams Jenkins has played an 
important part in this, as well as subsequent 
phases of the work. Grateful acknowledgment 
is made also to Mr. Ross Scroggs and Mr. John 
E. Young, of the Department of Radio, Tele- 
vision, and Motion Pictures, for their generous 
assistance and advice. 
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lasting about 30 seconds, have been re- 
tained, and occur 6-8 times in each se- 
quence. Each time the viewer responds by 
speaking into a microphone connected 
with a tape recorder. If he wishes to give 
no response he either remains silent or 
says "no response." Previously, the earlier 
(and much longer) film was shown to 
groups of therapists who recorded their 
responses in writing. 

Among the advantages of the sound 
film technique, the following are appar- 
ent: It provides the therapist-respondent 
with a fairly realistic sample of a person's 
behavior without depriving him of the 
visual and auditory cues usually present 
in an interview situation; 5 since each se- 
quence is presented as an initial interview, 
no prior knowledge of the patient need 
be assumed; the patient's verbal communi- 
cations occur in a context, and while the 
respondent may feel that the sample of 
the patient's behavior is too small to form 
a good impression, the same may be said 
about any interview or series of inter- 
views: the interviewer's knowledge is 
never "complete," since for diagnostic as 
well as therapeutic purposes he must 
always make inferences on the basis of 
limited information. 

On the debit side, the criticism of arti- 
ficiality is still cogent. There is no "true" 
interaction between respondent and pa- 
tient, and despite instructions to the con- 
trary, the viewer is reduced to a more or 
less passive bystander who is prevented 
from influencing the course of the inter- 
view which is immutably fixed on cellu- 
loid. Moreover, to some extent at least, 
any interviewer must "compete" with the 
film therapist By the same token, the re- 
spondent is deprived of the opportunity 
to assess the patient's reaction to him as a 
person a tremendously important source 
of information to the sensitive clinician 



5 The manner and extent to which therapists 
utilize auditory and visual cues is another prob- 
lem deserving much further study. 



nor can he evaluate the impact of his own 
communications on the patient. There is 
then the legitimate criticism that, in a real 
sense, the respondent is never "in the pic- 
ture." The foregoing objections do not 
exhaust possible criticisms, but the stric- 
ture that the film situation bears only a 
superficial resemblance to the essence of 
the therapeutic situation a living experi- 
ence between two participants is un- 
doubtedly the most serious one. Let it be 
noted that one or more of these comments 
were heard at one time or another from 
therapists, who for the most part however 
cooperated very willingly, even if they had 
reservations about the fruitfulness of the 
procedure. 

is THE "TEST" VALID? 

Such terms as "artificiality," "superficial 
resemblance," and the like are value judg- 
ments which proceed from the implied 
assumption that an experimental situation 
must bear a one-to-one relation to the 
"real" (therapeutic) situation. Clearly 
this extreme position is not defensible, 
nor has such a claim been made. Rather 
the issue resolves itself to the question 
raised earlier: What is the degree of 
validity? In other words, is there sufficient 
resemblance between the therapist's be- 
havior in the experimental and the real 
situation to consider the former a reason- 
able analogue of the latter? If the answer 
is essentially in the negative, we may be 
playing a fairly interesting game with 
therapists as participants, which may teach 
us something about their psychological 
make-up and performance in this particu- 
lar situation. The game may be relevant 
to or have a counterpart in the lives of 
these respondents, but their behavior vis- 
a-vis patients would not be one of them. 
If there is some validity in the procedure 
we know from test theory that even 
tests whose correlation with some external 
criterion is low can be exceedingly useful 
we have an intrisically interesting (face- 
valid) and appealing instrument, repeat- 
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able without variation, economical to 
administer, and most important capa- 
ble of generating and testing further 
hypotheses about the psychotherapist and 
his contribution to the therapeutic process. 
As already indicated, our interest is not 
only in the communications addressed by 
the therapist to the patient but also (and 
equally importantly) in such questions 
as: How is the patient perceived? How 
does the therapist react to him? What 
diagnostic impressions does he form? 
How are clinical impressions translated 
into plans and goals of therapy, etc.? 

As stated earlier, a criterion is difficult 
to define. What can be taken as a repre- 
sentative measure of the therapist's style 
or typical behavior in interaction with a 
patient? Undoubtedly there are variations 
in the therapist's behavior with Patient A, 
as compared with Patient B; or with Pa- 
tient A, in the first hour and in the tenth 
hour. There will be variations depending 
on the patient's attitudes, character struc- 
ture, and approach to the therapist, etc., 
etc. Despite such variations there are 
probably regularities or invariants in the 
therapist's behavior, determined by his 
training, level of experience, theoretical 
orientation, personality, etc. which more 
or less delimit and characterize his per- 
formance or "style/* It is precisely these 
more stable elements which we have been 
interested in exploring, on the assumption 
that they typically play a vital part in the 
therapist's relationships with his patients, 
and that, for better or for worse, they in- 
fluence the therapist's interaction. The 
goal, then, is to isolate from the multitude 
of idiosyncratic facets of the therapist- 
patient interaction variations introduced 
by the individual patient, the situation, 
the stage of therapy, and so on those 
variables which characterize most crucially 
a particular therapist's modus operandi, 
and to form a dearer picture of the na- 
ture of the therapeutic influence he exerts. 
If this formulation and its implied one- 
sided emphasis on what the therapist 
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"does" sounds odious, the matter may be 
stated from the patient's point of view: 
Which particular aspects of the therapist's 
behavior (attitude, communications, etc.) 
make it possible for the patient to use the 
therapeutic relationship to the end of 
modifying his own behavior, attitude, and 
psychic experience in ways which are 
more constructive and more adaptive, less 
conflictual and less conducive to the for- 
mation of mental and somatic symptoms, 
and more in keeping with adult standards 
of human behavior? 

Granted that the evidence for the 
validity of the experimental model is not 
well established, certain congruencies be- 
tween therapists' performance under the 
stated conditions and (admittedly impres- 
sionistic) information about character- 
istics of expert therapists, available from 
other sources, lends a measure of credence 
to the assertion. If the experimental pro- 
cedure is regarded as a psychological 
"test," the following correlates are analo- 
gous to trait validity coefficients (Camp- 
bell, 1960). The principal sources of sup- 
port include the following: 

1. As part of the experimental proce- 
dure in one major study (Strupp, 1958a), 
therapists were asked to formulate a brief 
statement of the psychodynamics of the 
patient portrayed in the film. A global 
rating of "dynamic quality" was made by 
independent raters taking into account the 
degree of complexity, degree of inference, 
precision, and operational aspects of the 
formulation. Low, but statistically signifi- 
cant, correlations were found between 
these ratings and therapists' experience, 
the more experienced therapists contribu- 
ting a larger proportion of formulations 
whose dynamic quality was rated high. 
This finding was obtained separately for 
fairly sizable groups of psychiatrists and 
psychologists. 

2. Similarly, qualitative ratings derived 
from therapists' formulations about the 
course of the transference showed that 
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the more experienced therapists tended to 
give statements in terms of interpersonal 
dynamics rather than statically descriptive 
ones. (This finding applied to the psychia- 
trist sample but not to the psychologist 
sample.) 

3. Each therapist's responses to the first 
sound film were rated on an over-all basis 
by independent judges for the presence 
or absence of empathy. 6 (It will be re- 
called that there were 28 stopping points 
in the film, hence 28 opportunities to 
respond.) While exceedingly gross, this 
over-all rating may be regarded as an 
index of the therapist's skill in establish- 
ing a professional relationship with the 
patient, keeping in mind the limitations 
and exigencies of the experimental situa- 
tion. There was a slight tendency (reliable 
at the .12 level) for the more experienced 
therapists to obtain a positive empathy 
rating a finding which might have 
escaped notice had it not been for addi- 
tional explorations in which the variable 
of personal analysis was taken into ac- 
count. Using two samples matched for 
experience, some interesting relationships 
emerged from comparisons between psy- 
chiatrists whose training had included a 
personal analysis and those whose train- 
ing had not Specifically, it was found that 
at the lower levels of experience (0-3 
years), a psychiatrist with personal analy- 
sis was as likely to obtain a positive 
empathy rating as an unanaly2ed col- 
league. At higher levels of experience, 
however, a sharp differentiation was ob- 
served: analyzed therapists received a 
much larger proportion of positive em- 
pathy ratings than unanalyzed psychia- 
trists, irrespective of whether the respond- 

The criteria which were used to judge the 
degree of empathy of therapists' responses are 
spelled out in Strupp (1958a, p. 62). Major 
elements included responsiveness to the pa- 
tient's problem, a willingness to extend help via 
a psychotherapeutic relationship, respect for 
the patient's suffering regardless of his hostility, 
anger, demandlngness, and seemingly anti- 
social attitudes. 



ent described his personal reaction to the 
patient as positive or negative. The prac- 
tical significance of this result seems to 
lie in the differential influence of the 
therapist's personal attitude toward the 
patient upon the degree of empathy com- 
municated to him, such that personal 
analysis, combined with experience, en- 
ables the respondent to be more empathic 
irrespective of his like or dislike for the 
patient. Stated otherwise, personal analy- 
sis seems to permit the therapist to sepa- 
rate his emotional reactions to the patient 
from his therapeutic activities (assuming 
that empathy, as defined in this study, is 
considered a desirable quality). Since a 
primary aim of personal analysis is to de- 
crease the therapist's subjectivity, the fore- 
going result accords with a prediction 
most experts would make from the psy- 
choanalytic theory of psychotherapy. 

4. There appear to be distinct qualita- 
tive differences, consonant with skills in 
empathizing with and responding to pa- 
tient communications, between the pro- 
tocols of highly experienced and inexperi- 
enced therapists. These differences are not 
easily specified objectively, but sophisti- 
cated judges have no difficulty in assign- 
ing a protocol to the appropriate group. 
Differentiating characteristics appear to 
be: a certain respectful warmth, incisive- 
ness in phrasing a comment, responsive- 
ness to the patient's feelings rather than 
the manifest content of his verbalizations, 
a quality of humaneness, ability to adopt 
the patient's frame of reference without 
"taking sides," etc 

5. Clear-cut differentiations were ob- 
served between therapists subscribing to 
diametrically opposed theoretical posi- 
tions, such as client-centered and analyt- 
ically oriented therapists. These differ- 
ences encompassed both communications 
as well as diagnostic, prognostic, and 
other clinical evaluations. 

While these indices, singly or collec- 
tively, cannot be considered as demon- 
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strating unequivocally the validity of the 
experimental model, they axe congruent 
with clinical data and general knowledge 
about the performance of psychothera- 
pists. In addition, the studies in which the 
procedure has been used (Strupp, 1958a; 
Strupp, 1958b; Strupp, 1958c) have 
yielded a number of new findings (for 
example, interrelationships between thera- 
pist's attitude toward the patient, clinical 
evaluations, and certain aspects of thera- 
pists' communications). Furthermore, con- 
firmation of these results was obtained by 
separately analyzing the data for samples 
of psychiatrists and psychologists, replica- 
tion of major findings on a new sample 
(Rieger, I960), and through the results 
of related studies using somewhat differ- 
ent methodologies (Strupp & "Williams, 
I960; Fey, 1958). 

SOME PROBLEMS OF RESEARCH STRATEGY 
AND METHODOLOGY 

Let it be conceded then if only for 
purposes of the argument that there is 
a certain congruency between a psycho- 
therapist's performance in the experimen- 
tal situation and his behavior in actual 
therapy. Perhaps this congruency is nar- 
rowly circumscribed, and will hold only 
for patients roughly resembling in per- 
sonality structure the patient portrayed in 
a particular film; perhaps wider generali- 
zations are justified. Whatever the answer 
may turn out to be, the question is of 
some importance, since it touches upon 
the therapist's flexibility, adaptability, or 
versatility. Rather than pursuing it fur- 
ther, I should like to address myself to a 
series of interrelated questions, which I 
hope this conference might help to il- 
luminate: 

To what extent does an experimental 
analogue touch crucial aspects of the 
therapist's contribution? If analogues cur- 
rently available fail to do so, is there a 
reasonable hope for realizing this goal in 
the future? If both answers are in the 
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negative, what are the alternatives? In 
phrasing the question this way, I invite 
renewed analysis of the old issue relative 
to the study of the naturally occurring 
events in psychotherapy vs. experimental 
approaches. 

These questions are essentially ques- 
tions of research strategy, and ultimately 
of research philosophy. At the same time, 
they appear to be realistic ones. As re- 
searchers, we are continually faced with 
the problem of deploying our resources, 
of investing our research energies and 
dollars to the end of obtaining the great- 
est possible returns. Each research project 
we undertake whether a methodological 
study or substantive research, a doctoral 
dissertation we sponsor, or a five-year pro- 
gram we outline to a granting agency 
each project demands a decision with far- 
reaching consequences for the profes- 
sional life and career of the researcher. 
For the most part, such decisions involve 
highly personal factors, which belong to 
the realm of autobiography rather than to 
science. Our predilections for theories, for 
research techniques, and for research 
topics are, as we know, determined to a 
greater degree by personal needs than by 
objective criteria, no matter how elo- 
quently we may defend the rationale of 
a procedure or approach which had been 
decided long before by considerations 
which, in some instances, we might pre- 
fer to remain ignorant about. It is likewise 
significant that whenever such questions 
are raised for debate, the discussion soon 
becomes emotionally tinged, and the par- 
ticipants tend less to defend their respec- 
tive positions than they become defensive 
about them. Yet, there should be other 
considerations determining the decisions 
under discussion. 

With respect to the therapist's contri- 
bution to the treatment process, the fol- 
lowing observations appear germane: 

1. Although the importance of the 
therapist variable has long been recog- 
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nized Freud introduced the concept of 
countertransference in 1910 virtually no 
objective research efforts have been de- 
voted to the problem until about ten 
years ago. Major reasons for this lag are 
probably (a) notable reluctance on the 
part of therapists to participate in research 
and to expose their therapeutic operations 
to the scrutiny of outsiders ( this problem 
has in some measure been overcome in 
recent years as evidenced, for example, by 
the widespread use of electronic sound 
recordings of therapeutic interviews for 
purposes of training, supervision, research, 
etc.); (b) the relative absence of truly 
sensitive research techniques for measur- 
ing differences in therapeutic technique, 
therapist's personality, attitudes, character 
of the emotional relationship between pa- 
tient and therapist, and the like; and 
(c) various difficulties in carrying out 
research projects over extended periods of 
time (methodological, financial, etc.). 

2. In recent years, much research effort 
has been invested by different researchers 
in laboratory-type, quasi-therapeutic in- 
vestigations. In this way it has been pos- 
sible to subject part-processes or segments 
to closer scrutiny by controlled research, 
but, as exemplified by the discussion re- 
lating to the research technique used in 
our studies, the question of validity, i.e., 
the degree to which we are dealing with 
processes which play a significant part in 
psychotherapy, remains unsolved. 

3. There has been a declining interest 
in naturalistic observation of the psycho- 
therapeutic process, the method by which 
Freud and others made most of the lasting 
contributions (see Luborsky, 1959, p. 
337). 

4. The major issue has been whether 
the therapist's contribution is primarily 
personal or primarily technical. In part, 
this issue is a philosophical one, with 
strong emotional commitments on both 
sides. In recent years it has become accen- 
tuated through the impact of existentialist 



teachings in this country (see, for ex- 
ample, May et aL, 1958). Partly, however, 
the problem is amenable to research, inso- 
far as it is possible to define and measure 
relevant treatment variables and to agree 
on measurable criteria of therapeutic out- 
comes. Greater progress, relatively speak- 
ing, has been made in research dealing 
with the technical aspects of the thera- 
pist's contribution (example: methods of 
content-analysis; manipulation of various 
techniques for therapeutic purposes, such 
as variations of interviewing techniques, 
operant conditioning, and the like), and 
greater investment of research effort has 
been made in this area than in investiga- 
tions dealing with the therapist's person- 
ality. As I have attempted to point out 
elsewhere (Strupp, 1959, 1960b), I be- 
lieve the deficiencies in research dealing 
with the therapist's personality have 
largely to do with problems of defining 
and measuring significant but highly elu- 
sive variables, such as: therapist's atti- 
tudes as communicated directly or (more 
importantly) indirectly through his com- 
munications which ostensibly have a tech- 
nical objective; his dedication, faith, com- 
mitment, emotional investment in therapy 
with a given patient all of which may 
have differential effects on his ability to 
empathize with, and respond to (inter- 
pret), the metaphoric aspects of the pa- 
tient's communications. None of the cur- 
rently available psychological techniques 
(tests, Q sorts, or whatever) seem to be 
even remotely sensitive to the detection 
and reliable measurement of these vari- 
ables. The conclusion appears inescapable 
that we have as yet little precise knowl- 
edge about the psychological impact of 
the person of the therapist on the person 
of the patient as well as about the relative 
permanence of changes taking place in 
the patients psychic structure. 

Restating the problem in somewhat 
different terms, it might be said that a 
large part of the difficulty arises from the 
fact that (a) linguistic symbols are inade- 
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quate to deal with the phenomena to be 
described, defined, and measured; and 
(#) psychotherapy as a technique relies 
heavily on verbal symbols to bring about 
changes in the affective processes of an- 
other person. There is nothing unique 
about Problem (#), which is a common 
problem in science, and which can often 
be successfully overcome. Problem (&), on 
the other hand, is truly a stumbling block. 
I should like to point up the researcher's 
problem by means of a common example. 

Patient X, let us say, comes to the 
psychotherapist and complains about 
marital difficulties. On the basis of various 
assessments the diagnosis is made that the 
difficulty cannot be "explained" by the 
"reality" of the situation. That is to say, 
the hypothesis is advanced that the prob- 
lem lies in the way X structures the situa- 
tion and responds affectively to this struc- 
ture (of which he is not aware) in such 
a way that the state of affairs is mirrored 
in consciousness as "anxiety,'* "inhibition," 
or "unhappiness." The verbal symbols 
which X uses to communicate to the 
therapist his consciously experienced dis- 
tress are in some manner related to an 
underlying structure (wish-defense), but 
neither participant at the beginning 
knows what "conflicts" in the underlying 
process give rise to the particular verbali- 
zations. X wants to "solve" his problem, 
that is, he wants to change himself, the 
other person, or the situation in such a 
way that his affective processes signal 
greater "happiness" or less "conflict." 
Typically, he wants a cognitive solution to 
a noncognitive problem. 

Now the therapist realizes that affective 
processes are not readily influenced in 
this manner, and he proceeds to approach 
the situation in different terms. He pro- 
ceeds to do psychotherapy, that is, he helps 
the patient the means need not concern 
us here for the moment to restructure 
his wish-defense system. It is merely re- 
stating a commonplace to say that the 
structure of X's wish-defense system 



(psychic apparatus) is not directly ob- 
servable, but must be inferred from his 
relationship to the therapist (transfer- 
ence). To an important degree but by 
no means exclusively this relationship is 
mediated by verbal communications. At 
some points, feelings toward the therapist 
are expressed directly (anger, crying, 
etc. ) , but for the most part, X's affects are 
bound (defended against). It is the cur- 
rent state of X's wish-defense system that 
the therapist is interested in, and he learns 
about it through clues from the patient's 
verbal and nonverbal communications. 
The clues may derive from a large variety 
of sources (gestures, inflection, associative 
trends, attitudes, bodily tensions, silences, 
etc.), but the inferential process is the 
therapist's. It is he who on the basis of 
training, experience, clinical acumen, etc. 
sifts, arranges, and structures the data to 
form a hypothesis about the current state 
of affairs of the patient's emotional dy- 
namics. His verbal communications are 
designed to alter the dynamics in ways 
which he judges to be therapeutic (per- 
mitting freer and more direct expression 
of feelings through enfeeblement of the 
defenses). 

The grave difficulty, from the research- 
er's point of view, results from the lack 
of invariance between the verbal symbols 
(their syntactic meaning) and the under- 
lying emotional process to which they (in 
part) refer. Put otherwise, it is the differ- 
ence between secondary and primary 
process. If we are interested in analyzing 
the content of the patient's communica- 
tions, how can one identify and define 
measurable units? What metric can one 
use? Similarly, how can the therapist's 
communications be dealt with quantita- 
tively? To call a communication an "inter- 
pretation" is of some value, but this is 
merely a beginning. To measure "depth" 
or "degree of inference" presently involves 
one in a host of difficulties. Even if such 
a judgment is made the experience of 
several investigators shows that it can be 
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done with a fair degree of reliability 
only a relatively superficial characteristic 
has been measured. Similar problems con- 
front a group of external observers who 
may be called upon to describe and con- 
ceptualize the events in a given hour of 
therapy (see, for example, the work of 
Bellak & Smith, 1958, and the more re- 
cent work of the group associated with 
Franz Alexander [Levy, I960] ) . 

In some exploratory work of my own, 
I devised a rating sheet which the thera- 
pist completes at the end of each hour. It 
calls for simple (5 -point) ratings of such 
variables as anxiety, defensiveness, re- 
sistance, etc. Correspondingly, the thera- 
pist rates the relative frequency of his 
interventions, interpretations, the nature 
of his attitudes toward the patient, and 
so on. It is too early to evaluate the kinds 
of data generated by such a device. Since 
ratings must be made over an extended 
period of time, the statistical problems are 
quite complex. I suspect we shall find that 
the value of such ratings is fairly narrowly 
circumscribed, because they are at best 
only an epiphenomenon of the interplay 
of forces, which themselves undergo con- 
tinual shifts during a single therapeutic 
hour. What moment of the hour do the 
ratings represent? Often there may be sev- 
eral discernible shifts in a single hour. If 
this is so, how do we demarcate the units? 
The ratings may to some degree measure 
important aspects of the patient-therapist 
interaction, but their sensitivity is prob- 
ably not very great. This is not to preclude 
the possibility that they may illuminate 
some aspects of the interaction (such as 
relationships between therapist's attitude 
toward the patient, intensity of the pa- 
tient's resistance and depth of interpreta- 
tions, etc.) . They may also help to sharpen 
the therapist's powers of observation be- 
cause the rating procedure forces atten- 
tion to a systematic assessment of impor- 
tant variables. 

Theories of psychotherapy attempt to 
account for the changes occurring in the 



patient in terms of the therapeutic rela- 
tionship, or, more accurately, in terms of 
the patient-therapist interaction in the 
therapeutic relationship. Even in the 
psychoanalytic theory of psychotherapy, as 
I have tried to elaborate elsewhere 
(Strupp, 1960c), opinion is by no means 
undivided concerning the precise nature 
of the therapeutic action. Clearly, a re- 
arrangement of psychic forces does take 
place, and it is attendant upon a more or 
less intense emotional experience by the 
patient. There is strong reason to believe 
that (at least in intensive psychotherapy) 
the favorable therapeutic change is due to 
something more than the therapist's re- 
spectful, benevolent, tolerant, empathic, 
etc. attitude toward the patient. This 
"something" is usually (and undoubtedly 
correctly) subsumed under the heading of 
the therapist's technical operations (inter- 
pretations, analysis of resistances, etc.). 
The crucial question, however, remains as 
to the precise manner in which the com- 
munication of verbal symbols impinges 
upon, affects, and modifies the patient's 
psychic economy. Whatever changes take 
place, their effects can only be measured 
indirectly, as in changed attitudes of the 
patient toward himself and others, di- 
minution of symptoms, greater subjective 
comfort, greater productivity, etc. 

Psychological measures of many kinds, 
to be sure, are indirect, and no less valu- 
able on that account. As I have tried to 
indicate in the foregoing, the problem 
becomes acute in content-analysis studies 
of psychotherapy, when in quantitative 
indices derived from verbal symbols a 
kind of isomorphism is assumed between 
the verbal symbols and the underlying 
psychic process. The training of the 
psychotherapist is largely aimed at sensi- 
tizing him to the metaphor in linguistic 
symbols, that is, it fosters the ability to 
read "between the lines," an ability pos- 
sessed to some degree by everyone. This 
dinical sensitivity, unfortunately, cannot 
be built into measurement instruments 
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available today, nor can it be programed 
for electronic computers. 

For the reasons mentioned, efforts to 
improve and refine naturalistic observa- 
tion, i.e., sharpening of the incomparably 
more sensitive human observation instru- 
ment, may be more productive in expand- 
ing the frontiers of knowledge than ex- 
perimental or quasi-experimental ap- 
proaches. The method of naturalistic ob- 
servation, as we know, has its own diffi- 
culties. However, such efforts at controlled 
observation as carried out by the research 
group of Franz Alexander may in the long 
run be highly productive, provided it is 
possible to bring to bear a variety of theo- 
retical frames of reference on the obser- 
vations made by trained judges. 

BRIEF REVIEW OF OUR PROGRAM 

In the remaining space I shall present 
a brief sketch of our program where it 
started, where we hope it is going, and 
the kinds of problems it has attempted to 
tackle. 

Therapists' perceptions, clinical evalua- 
tions, communications, attitudes towards 
patients, and interrelationships of these 
variables. A series of quasi-experimental 
studies (Strupp, 1958a, 1958b, 1958c) has 
shed some light on differences in thera- 
pists* reactions to an identical stimulus 
situation (a simulated interview) and has 
attempted to account for observed varia- 
tions in perceptions, evaluations, and com- 
munications directed to a patient in terms 
of the therapist's theoretical orientation, 
level of experience, attitude toward the 
patient, and the like. The experimental 
procedures by which these investigations 
were mediated have been examined in the 
course of this essay; since the substantive 
results of this work have been reported in 
the cited references, they need not be re- 
peated here. I believe we have had some 
success in elucidating the influence of 
therapist variables upon clinical evalua- 
tions and therapeutic operations. The find- 
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ings have also served as a stimulus to in- 
quire further into the nature of the thera- 
pist's contribution (Strupp, 1959; Strupp, 
1960c) to refine the experimental method 
(see the earlier discussion in this paper) , 
to take a critical look at the potentialities 
of experimental research in this area in 
general (Strupp, 1960b) , and to stimulate 
alternate research approaches. With re- 
spect to the last point, it was possible to 
confirm the high degree of positive asso- 
ciation among therapists' judgments of the 
patient's capacity for insight, lack of de- 
fensiveness, motivation for therapy, favor- 
ableness of prognosis, and the therapist's 
liking for the patient (Strupp & Williams, 
I960). The confirmatory strength of this 
study lies in the fact that the ratings were 
made by two therapists following inde- 
pendently conducted interviews with some 
20 patients. Thus, contrary to the earlier 
experimental studies, the statistical associa- 
tion refers to a sampling of patients rather 
than of therapists. Wallach and Strupp 
(I960) experimentally varied the varia- 
ble "motivation for therapy" in presenting 
written case histories to a group of thera- 
pists, and were able to adduce evidence 
in favor of the hypothesis that, within 
limits set by the patient's degree of dis- 
turbance, more highly motivated patients 
are given more favorable prognostic rat- 
ings and tend to be better liked by thera- 
pists. W. S. Jones, in a study recently 
completed, showed that college students, 
having no familiarity with psychotherapy 
as patients, therapists, or students tend to 
vary in their reactions to patients pre- 
sented to them via sound films, depending 
on their own authoritarian attitudes, as 
measured by the well-known F Scale. He 
found that high authoritarians tend to be 
more rejecting of a hostile, demanding 
patient, and more directive and moraliz- 
ing in their communications to him, than 
students obtaining low F Scale scores. 
While these findings cannot be directly 
translated to the therapeutic situation, 
they may throw some light on the atti- 
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aides of therapists who evinced rejecting 
attitudes toward the same film patient in 
an earlier study. Jones contributed a num- 
ber of additional results having a bearing 
on this problem. 

Toward the comparative study of thera- 
pists' operations. An interest in developing 
techniques for quantifying the therapist's 
communications led to the development 
of a multidimensional system of analysis 
(Strupp, 1957a) which attempted to 
assess each communication in terms of 
five dimensions: type of therapeutic ac- 
tivity, depth-directedness, dynamic focus, 
initiative, and therapeutic climate. The 
system was used in quantifying therapist's 
communications in the experimental in- 
vestigations reported earlier, as well as in 
several analyses of actual therapy inter- 
views. Thus a series of interviews reported 
by Wolberg (1954, pp. 688-780) was 
analyzed (Strupp, 1957b); subsequently, 
a comparison between therapist's activity 
in the Wolberg series was compared with 
Dr. Carl Rogers in a somewhat compara- 
ble case history (Strupp, 1957c). These 
studies can be considered only a begin- 
ning; however, it is clear that in the future 
more adequate methods must be found to 
carry out comparisons between therapists 
subscribing to different theoretical sys- 
tems. A continuing need exists for ab- 
stracting and measuring dimensions in 
therapists' communications which cut 
across theoretical frameworks. 

A few limitations of content-analysis 
systems have been discussed in earlier 
pages. With respect to the system devel- 
oped in the course of our program, con- 
siderable overlap among the several di- 
mensions was found, resulting in a recent 
modification by Strupp, Williams, and 
Wallach. This modification reduces the 
various dimensions to a single series of 
categories ("types" of therapeutic ac- 
tivity), with provision for scaling the 
interpretive "depth" of communications. 
While this revision appears to retain most 



of the measures previously obtained by 
the system, it fails to do justice to the 
attitudinal component. That is to say, the 
quantitative indices give some informa- 
tion about the "kinds" of communications 
the therapist uses (for example, questions, 
interpretations, etc.) as well as their de- 
gree of inference ("depth" ) ; however, the 
system has nothing to say about the degree 
to which the therapist empathizes with 
the patient, the warmth, gentleness, etc. of 
his comments, or any other connotative 
qualities. This omission is no reflection 
on the importance of these aspects on 
the contrary, it should be apparent that I 
consider them crucial rather it demon- 
strates our inability to devise objective 
and reliable measures. 

Studies in progress. In conclusion, I 
wish to list briefly the studies currently 
being carried out by members of our 
group or by graduate students working 
under our direction: 

1. A series of six motion pictures has 
been produced over the past several years, 
each approximately 15 minutes in length 
and depicting an interview with patients 
manifesting fairly typical but contrasting 
neurotic problems. These films are being 
used in the manner described earlier to 
collect data from groups of psychothera- 
pists. Currently, data from some 60 thera- 
pists who responded to two films are 
being analyzed statistically. In a subproj- 
ect we are evaluating differences in 
therapists' responses when the subject 
writes his "communications" to the pa- 
tient as opposed to speaking into a micro- 
phone. Preliminary results indicate that 
the "spoken" method is generally pre- 
ferred by therapists as more natural, face- 
valid, and convenient, and that it results 
in longer communications (roughly twice 
the number of words). In addition, the 
method of recording permits at least 
potentially the analysis of nonverbal 
(attitudinal) elements in therapists' com- 
munications. 
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2. In an effort to learn more about 
patients* perceptions of the therapeutic 
relationship, retrospective data from for- 
mer psychotherapy patients have been col- 
lected by means of a fairly extensive 
questionnaire. The analysis of these data 
will focus on the quality of the therapeu- 
tic relationship and personality aspects of 
the therapist, as perceived retrospectively 
by these patients. While the number of 
cases thus far available is small (about 
40), the data refer to four or five patients 
of each collaborating therapist. Thus it is 
hoped that it will be possible to (a) study 
differences in the perceptions of different 
patients who have been seen by the same 
therapist, and (b) relate the data obtained 
from patients to comparable ratings and 
evaluations by their former therapists. 

3. Another study in progress is de- 
signed (a) to replicate previous findings 
relative to the interrelationships between 
therapist's attitudes towards a patient, 
clinical impressions, and treatment recom- 
mendations, and () to arrive at a clearer 
understanding of the kinds of informa- 
tion, impressions, attimdinal components, 
etc. affecting estimates of the patient's 
motivation for therapy. The investigation 
requires that over a period of one year 
every patient seen in the Psychiatric Out- 
patient Clinic of N. C Memorial Hospital 
for a diagnostic work-up be rated on a 
number of rating scales by the medical 
student or resident conducting the diag- 
nostic interview. In addition, immediately 
upon termination of the interview, the 
interviewer completes some open-ended 
questions. In contrast to earlier work, the 
present study utilizes ratings based on 
actual interviews with a large number of 
patients. Furthermore, it will provide data 
on the performance of two groups of 
relatively well defined respondents (med- 
ical students and psychiatric residents). 
The results of this investigation may have 
direct application to the psychiatric set- 
ting from which they derive. 
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4. Closely related to, and partly over- 
lapping, the foregoing investigation is 
another study focused upon the isolation 
of variables which might be prognostic of 
a patient's entering and remaining in 
psychiatric treatment. Such variables may 
be divided into two groups: (a) those 
which may be said to reside in the patient, 
such as age, sex, degree and kind of ill- 
ness, motivation for therapy, etc, and (b) 
those which are more directly attributable 
to the interviewer or therapist, such as his 
level of experience and his liking for the 
patient. Pertinent data have been collected 
on all persons coming to the outpatient 
clinic for a diagnostic evaluation during 
the first five months of I960. Additional- 
ly, information is available on final diag- 
nosis, recommendations for treatment, 
duration of therapy, experience level of 
the therapist, as well as the data described 
in the preceding paragraph. Finally, ques- 
tionnaires sent to patients subsequently 
provide data on the patient's feelings 
about the diagnostic and/or therapeutic 
experience and his current well-being. 

These additional data are potentially 
valuable for several reasons. Many of the 
patients who are seen for diagnostic evalu- 
ation in the clinic are not seeking psycho- 
therapy nor is it recommended for them. 
Of the others, however, a large proportion 
are seen less than five additional times. It 
will be important to determine whether 
short-term cases can be predicted, either 
on the basis of the patient's characteristics 
or on the basis of the characteristics of 
the interviewer or therapist. Conversely, 
it would be encouraging if one were bet- 
ter able to match the "good patient" with 
the "good therapist." 

5. Longitudinal ratings of a series of 
therapeutic variables (see above) are 
being collected from two therapists seeing 
several patients in psychotherapy. It will 
be recalled that the therapist completes a 
rating sheet on a number of patient and 
therapist variables following each therapy 
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hour. (This project is carried out in col- 
laboration with Drs. John A. Ewing and 
J. B. Chassan.) The objective is to (a) 
develop an instrument which would aid 
in making systematic observations of the 
therapeutic process, and (b) study ob- 
jectively patient changes in selected vari- 
ables over an extended period of time, in 
relation to self -rated therapist attitudes. 
Supplementary process notes are also 
being collected. 

6. Following a study recently reported 
by Knupfer, Jackson, and Krieger (1959), 
a project by Mr. Ron E. Fox is intended 
to compare personality characteristics of 
psychotherapists (psychiatric residents) 
receiving high or low ratings on several 
dimensions of competence. The earlier 
study was carried out on subjects treating 
primarily schizophrenic patients. The 
present study focuses on therapists treat- 
ing principally neurotic patients. In addi- 
tion, therapists' personality characteristics 
are being studied in relation to typical 
neurotic personality patterns displayed by 
patients applying for therapy to an out- 
patient clinic. 

7. Stimulated by an interesting study 
published by Colby (I960), we are in 
the process of designing several studies 
attempting to explore some basic dimen- 
sions relating to the process of free 
association. Considering the widespread 
use of the technique of free association in 
psychotherapy, it is amazing how little 
systematic research has been conducted 
on the conditions determining content, 
resistances, and the like. Colby was con- 
cerned with the effects of the presence of 
an observer (quasi-therapist) on the con- 
tent of free associations (significant per- 
sons in the subjects' lives). The proposed 
research (to be carried out by Mr. Gary 
Olson) is expected to make a contribution 
to a rather neglected area. 

As may be noted from the foregoing 
developments, we are directing our atten- 



tion increasingly to research concerned 
with (a) greater systematization of ob- 
servations of the naturally occurring 
events in psychotherapy, (b) basic proc- 
esses in psychotherapy, and (c) patients' 
perception of psychotherapy and the 
therapist's personality. We are continuing 
research, albeit with somewhat less em- 
phasis, on the personality of the psycho- 
therapist. 
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Experiences in Research in Psychotherapy 

with Schizophrenic Patients 1 
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For this Second Conference on Re- 
search in Psychotherapy, I have been 
asked to prepare a paper on the topic of 
the psychotherapist's contribution to the 
treatment process as it affects the progress 
and outcome of therapy. This invitation 
surely reflects interest in studies which 
Dr. John Whitehorn and I have been 
carrying out at the Henry Phipps Psychi- 
atric Clinic of the Johns Hopkins Hos- 
pital during the past several years. There- 
fore, I shall give an account of some of 
these studies and their substantive results. 
I shall then present a discussion of modes 
of research in psychotherapy, in an effort 
to consider, in basic terms, procedures and 
methods relevant to some of the realities 
of the clinical phenomena involved. I 
hope that the data and experiences to be 
reported, and the lines of thought into 
which they have led, will stimulate not 
only critique although that is welcome 
but also imaginative appraisal as to 
their implications for further clarification 
of the psychotherapeutic process. 

The studies which I shall describe have 
not been concerned with the nature of 
"psychotherapy" in an abstract or general 
sense. Their aim has been to establish 
with definite reliability what makes a dif- 
ference in the treatment of schizophrenic 
patients. The research focus has been on 
the schizophrenic patient in actual thera- 
peutic contact with his doctor. This focus, 

x From the Henry Phipps Psychiatric Clinic 
of the Johns Hopkins Hospital. This work has 
been supported in part by funds from the 
Scottish Rite Committee on Research in De- 
mentia Praecox of the Supreme Council, Thirty- 
Third Degree Masons, Northern Jurisdiction, 
administered by the National Association for 
Mental Health. 



we felt, would provide a simultaneous 
source of data for illuminating the nature 
of the clinical problem and the nature of 
its solution. The directions taken by these 
studies have been guided by two basic 
questions: (1) What are the underlying 
conditions in the patient which give rise 
to and sustain the schizophrenic reaction, 
to the exclusion of more effective be- 
havior? (2) What are the conditions in 
the treatment situation which facilitate or 
hinder the reduction of the schizophrenic 
mode of reaction and its replacement by 
more satisfactory personal and social ca- 
pacities? The first question is dearly a 
search for diagnostic specificity, the second 
for therapeutic specificity. In the tradition 
in which clinical medicine has raised its 
scientific status, the two questions are 
interlocking. 

The broad lines along which these 
studies have been conducted might be 
designated an operational approach. Clin- 
ical situations were not contrived in order 
to investigate them by a priori methods 
and design. Actual clinical operations, 
ongoing whether investigative interest 
was brought to bear on them or not, were 
utilized as a continuing source of grass 
roots data. The approach has been to at- 
tempt to capture, by systematic attention, 
what is authentic and vital in these clin- 
ical operations. 

PART I. RESEARCH STUDIES 
AND RESULTS 

Phase I. 1943-1950: Method of Partici- 
pant- O bservation 

Studies of individual schizophrenic pa- 
tients were carried out over a number of 



42 



RESEARCH IN PSYCHOTHERAPY 



years in which the investigator was the 
patient's therapist and functioned as a 
participant-observer. This mode of study 
was effective in shedding light on some 
of the meanings and motivations in the 
schizophrenic patient's behavior, and also 
in demonstrating his latent potentialities 
for more normal and satisfying behavior. 
It also produced indications that the con- 
ditions in the treatment situation which 
affected the dinical course favorably lay 
in the actual, present relationship between 
the patient as a person and the doctor as 
a person. 

Subsequently, as I shall describe below, 
methods were developed for exploring the 
importance of the psychotherapist's per- 
sonal qualities in determining his effec- 
tiveness in working as a therapeutic part- 
ner with the schizophrenic patient. These 
later studies yielded independent data 
which warrant the statement, as a general 
principle, that the doctor is the important, 
even crucial, factor in determining the 
outcome of treatment with schizophrenic 
patients. 

Although this conference is not focused 
on the schizophrenic illness, some under- 
standing of this psychotic reaction is 
essential to understand the progress of the 
studies Dr. Whitehorn and I have been 
making. As is well known, the schizo- 
phrenic illness is the most serious of 
mental disorders. It tends to run a chronic 
course unless interrupted by effective 
therapeutic intervention. Cases that are 
episodic or self -curing are the exception 
rather than the rule. A favorable turn in 
the clinical course is not readily achieved 
even with therapeutic effort, and the prog- 
nosis for the individual patient, in terms 
of statistical probability of favorable out- 
come, remains grave. 2 Various physical 
therapies (insulin, electric shock, tran- 
quilizing drugs) have affected sympto- 

2 Twenty-five percent of all the hospital beds 
in the United States are occupied by schizo- 



matic improvement in numbers of these 
patients, and reduced the doctor's feelings 
of therapeutic helplessness. However, such 
symptomatic improvement has tended to 
be transient unless deeper, human prob- 
lems underlying the symptoms could also 
be resolved. 

Because the nature of these deeper, 
human problems remained quite obscure 
20 years ago, our studies, then, were con- 
cerned with searching them out and illu- 
minating them, as a requirement for de- 
veloping a body of knowledge about 
means to their therapeutic solution. 

From the participant-observer mode of 
study, the meaning of the schizophrenic 
patient's characteristic social distance be- 
came increasingly intelligible as a sensi- 
tive, interpersonal pattern of separateness, 
motivated by fearful and hateful distrust 
of himself and others. A common theme 
was noted to underlie the many varieties 
of clinical manifestation, centering about 
the issue of "authority," Much of the 
psychotic symptomatology and behavior 
became meaningful as an expression of a 
special orientation toward "authority" as 
external and imposed its source in 
others, not in the self. The patient's class- 
ical inward experience of feeling "con- 
trolled" or "influenced" by outside forces 
both expresses, and is an indicator of, his 
dominant concern with imposed authority. 
This theme was apparent in the patient's 
image of himself and of others in his life, 
including the doctor. 

In the participant-observer mode of 
study it was possible to see this special 
problem of authority resolve itself, as (a) 
the patient developed a trusting, confiden- 
tial relationship with the doctor, and (b) 
as he began to locate and rely on his own 
inner resources as reliable guides for per- 
sonal and social behavior. These two 
changes in attitudinal orientation were 
accompanied by the simultaneous attenua- 
tion or disappearance of clinical "schizo- 
phrenia." 
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The establishment of such a confidential 
relationship with the schizophrenic pa- 
tient, once thought not to be possible, is 
not readily accomplished. In these early 
studies, it was observed that modes of 
approach by the therapist which exempli- 
fied personal steadiness and firmness 
coupled with a sense for mutual free, and 
fair, play were effective in evoking the 
patient's trust and spontaneity. This was 
shown first in the relationship with the 
doctor, later in broadened social partici- 
pation with others. 

Why is this confidential kind of rela- 
tionship so difficult to achieve with the 
schizophrenic patient? Do some doctors 
achieve it more readily and frequently 
than others? If so, why and how? Ques- 
tions such as these sharpened interest in 
focusing more intensively on the person- 
ality of the doctor as an important factor 
in the treatment of the schizophrenic pa- 
tient. In particular, it seemed desirable to 
investigate possible variations in the ap- 
proach of different doctors. 

In order to accomplish this it became 
necessary to find a mode of investigative 
procedure which would enlarge the possi- 
bilities of observation beyond what a 
single therapist working as a participant- 
observer could do. In the method of par- 
ticipant-observations, the individual psy- 
chiatrist can apply himself to the task of 
individual therapy- in patient after patient, 
can observe whether the patients seem to 
gain increasing benefits, and can attempt 
to analyze the interpersonal transactions 
to ascertain if possible what has been 
helpful and what has not. But this experi- 
mental method has serious limitations. 
The total sample which can be accumu- 
lated is necessarily limited. To a certain 
extent it is possible, in a planned way, to 
vary somewhat one's style and method of 
attempted psychotherapy. But it is difficult 
for one physician to plan and maintain 
crucially different approaches and atti- 
tudes, for the sake of planned experimen- 



tation, because some of the significant 
variables appear to be manifestations of 
his own personal characteristics, not 
readily changed by planned effort. For the 
same reason, it is difficult, if possible at 
all, to "coach" another person in a certain 
experimentally designed "role" in which 
he is expected to participate with a pa- 
tient for research purposes. 

Phase 11 1950-1955: Studies of Differ- 
ences in Clinical Style 

Because of these difficulties and because 
of the possibility that subtleties in the 
doctor's personality made a difference in 
the schizophrenic patient's response, an- 
other methodological approach for carry- 
ing out systematic studies in this tech- 
nically difficult field was devised. In this 
new approach, the investigator is not a 
therapeutic participant with the patient, 
but studies the therapeutic transactions 
and events which take place between 
other doctors and their schizophrenic pa- 
tients. This method brings a much larger 
sample of doctors and patients under 
study. Similarities and contrasts between 
different physicians in their styles of 
clinical transactions with schizophrenic 
patients, and in their personal character- 
istics can now be looked for and syste- 
matic comparisons made, designed to 
reveal any differential effects on the pa- 
tient's progress and outcome. 

Fortunately it was not only desirable to 
make such a shift in the mode of investi- 
gative procedure, but also possible, in the 
working situation at the Phipps Clinic. 
The resident psychiatrists and their schizo- 
phrenic patients now became the focus of 
study. In pursuing the aims of looking 
for contrasting personal characteristics in 
the doctor, relevant to different patient 
outcome, two methods of study have been 
successfully utilized. The first was a study 
of data recorded in the individual case 
records by the doctors and by nurses dur- 
ing the time when treatment was in 
progress. This method yielded character!- 
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zations of the doctors in terms of differ- 
ences in their clinical "styles" in thera- 
peutic transactions with their schizo- 
phrenic patients. 

The second method was to study the 
personal interest patterns of the doctors 
by the use of an independent instrument, 
the Strong Vocational Interest Inventory. 
By the use of this second method, as will 
be described in detail below, it has been 
possible to predict successfully, in advance 
of therapeutic performance, that doctors 
with one kind of personal interest pat- 
terns will hate a high proportion of their 
schizophrenic patients improve, and that 
doctors with an opposite kind of personal 
interest patterns will have a lower pro- 
portion improve. 

First, however, it was necessary to see 
whether doctors differ in the improve- 
ment rates achieved with schizophrenic 
patients. That doctors do differ, only some 
consistently getting high improvement 
rates, 3 was demonstrated in the following 
way. A list of doctors was assembled, each 
of whom had treated a minimum of four 
schizophrenic, four depressed, and four 
neurotic patients (to control for the vari- 
able of range of clinical experience). The 
improvement rate with schizophrenic pa- 
tients achieved by each of the doctors was 
then calculated by dividing the number 
of patients discharged "improved" by the 
number treated. The physicians were then 
listed in order of descending rank. This 
procedure was carried out on two inde- 
pendent samples of doctors. For conveni- 
ence, doctors achieving 68% or better 
improvement rates with their schizo- 
phrenic patients were designated as A 
physicians, those achieving 67 % or lower 
improvement rates as B physicians. In an 
initial series of 14 doctors, the A physi- 
cians averaged an improvement rate of 
75 fc with their 48 schizophrenic patients, 
while the B doctors averaged an improve- 

3 Criteria of improvement are discussed in 
detail in a later section. 



ment rate of only 27% with their 52 
schizophrenic patients. In a second series 
of 18 doctors, the A physicians averaged 
an improvement rate of 82% with their 
schizophrenic patients and the B doctors 
only 34%. 

Why did the schizophrenic patients of 
the A doctors improve almost three times 
as frequently as the schizophrenic pa- 
tients of the B doctors? 

The possibility that the patients of the 
A doctors were clinically "easier" cases 
than those of the B physicians was ruled 
out by a detailed comparison of the two 
patient groups in respect of certain per- 
sonal and clinical characteristics which 
revealed that both patient groups were 
initially clinically comparable. The possi- 
bility that the A doctors were "better 
therapists" than the B doctors, with 
greater general therapeutic aptitude was 
ruled out by demonstrating that both 
physician groups did equally well with 
other types of patients than schizophrenic. 

The possibility that the A doctors car- 
ried out their therapeutic transactions in 
a different style than did the B doctors, 
and that these differences were related to 
differences in therapeutic outcome, re- 
mained to be explored. When this was 
done, by a detailed analysis of the indi- 
vidual case records, differences in clinical 
"style" between the A and the B doctor 
groups were demonstrated at high levels 
of statistical significance by the chi square 
test. (Details of the findings and the 
methods have been reported elsewhere 
(Whitehorn & Betz, 1954, 1956, 1957). 
The empirical findings may be summar- 
ized briefly for the present purpose. The 
A doctors, more frequently than the B 
doctors, it was found, grasped the per- 
sonal meaning and motivation of the 
patient's behavior, going beyond mere 
clinical description and narrative biog- 
raphy. Likewise, the A doctors, more 
frequently than the B doctors, selected 
personality-oriented rather than psycho- 
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pathology-oriented goals in the treatment 
of a particular patient, i.e., aimed at assist- 
ing the patient in definite modification 
of adjustment patterns and more construc- 
tive use of assets rather than mere decrease 
of symptoms or correction of faulty 
"mechanisms." Finally, while the B doc- 
tors tended to be passively permissive 
or to point out to a patient his mistakes 
and misunderstandings and to interpret 
his behavior in an instructional style, the 
A doctors did little of this. Rather they 
expressed attitudes more freely on prob- 
lems being talked about, and set limits 
on the kind and degree of obnoxious be- 
havior. The patients of the A doctors were 
those with whom trustful communication 
was most frequently established. They 
were also the patients who reached the 
highest levels of excellence of improve- 
ment. 

The chi square test was used to estab- 
lish that the differences between the two 
doctor groups had statistical significance. 
The level of significance was .001. 

These findings were established in an 
initial series of 14 doctors and 100 
schizophrenic patients, and were cross- 
validated on an independent sample of 
18 doctors and 109 schizophrenic patients. 

In a follow-up study on these 209 
schizophrenic patients five or more years 
after discharge, 70% were rated as still 
improved. 

In summary, these studies provided 
data to support the conclusion that differ- 
ences between doctors exist, manifest in 
differences in their clinical "styles" with 
schizophrenic patients and highly associ- 
ated with differences in patient outcome. 
Alternative explanations for the differ- 
ences in patient outcome were controlled 
by establishing that both groups of doc- 
tors were comparable in clinical experi- 
ence, in their therapeutic effectiveness 
with patients other than schizophrenic, 
and in the kind of schizophrenic patients 
treated. 



Phase III. 1956-1960; Studies of Doctor's 
Personal Values Based on the Strong Vo- 
cational Interest Inventory 

An independent method for discrimi- 
nating between A and B doctors was next 
sought. Means for doing this were devel- 
oped from a series of empirical studies 
utilizing the Strong Vocational Interest 
Inventory for characterizing the doctors 
in terms of personal interest patterns. By 
the use of this inventory it has been pos- 
sible to identify differences in personal 
interest patterns and attitudes between 
the A and B doctors, and to explore the 
relevance of these differences to differ- 
ences in the outcome of treatment of 
schizophrenic patients. 

The Strong Inventory is a well stand- 
ardized research tool, not psychopatho- 
logically oriented but focused on human 
interests. It selects out from a fairly wide 
range interests highly shared by an indi- 
vidual with some groups of his fellow 
beings, and interests only slightly shared 
with other groups of persons. In all, the 
Inventory matches the interest patterns 
of any given individual with known in- 
terest patterns of individuals in 45 voca- 
tions, by a scoring scale ranging from 
high to low matching. (All tests in these 
series were machine scored by the Testscor 
Service in Minneapolis.) 

A brief account of these studies will 
now be presented (Betz, 1958; White- 
horn & Betz, I960; Whitehorn, I960). 

At the present time, the research ma- 
terial consists of 72 physicians whose 
therapeutic results with schizophrenic pa- 
tients are known, and on whom Strong 
Vocational Interest Test scores are avail- 
able. Twenty-six of these physicians are 
among those on whom our original 
studies of styles of clinical transactions 
with schizophrenic patients were based 
(15 A and 11 B). The remaining 46 
physicians (28 A and 18 B) represent a 
separate group accumulated subsequently 
whose therapeutic performance with their 
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schizophrenic patients during their resi- 
dency training became known. 

As an initial step in analyzing this ma- 
terial, a comparison was made of the 
Strong Test scores of the 15 A and 11 B 
physicians on whom our earlier clinical 
studies have been based. From this com- 
parison some interesting findings emerged. 
Both physician groups scored high in 
three vocations: Physician, Psychologist, 
and Public Administrator. In 38 other 
vocations differences in the scores of the 
two physician groups were not found. 

By the scores on 4 vocations, however, 
it was possible to detect definite differ- 
ences in the interest patterns of the A and 
B physicians. These differences are at 
levels of statistical significance between 
.10 and .02 by the chi square test. The 
actual findings are shown in Table 1. 
These four vocations are: Lawyer and 
Certified Public Accountant (A's high, 
B's low); Printer and Mathematics Phys- 
ical Science Teacher (A's low, B's high). 
These empirical findings are independent 
data constituting a source of possible 
clues to some distinguishing personal 
characteristics of each physician group, 
relevant to their different therapeutic re- 
sults and their different styles of clinical 
transaction with schizophrenic patients. 

Development of First Predictive Screen 

We next considered how these observa- 
tions on interest patterns might serve as 
a predictive device to indicate which 



physicians would have high improvement 
rates with schizophrenic patients and 
which would not. 

We had no particular interest in any 
direct application of such a predictive 
device in the assignment of physicians to 
patients. In fact, we wished to avoid any 
such maneuver, intentional or uninten- 
tional, because it could bias our investiga- 
tion. Rather we thought that a predictive 
study, if successful, would serve as a rigor- 
ous check on the validity of the differences 
observed in the first study. 

Furthermore, the level of predictive ac- 
curacy might serve as an indicator whether 
the crucial determinants of successful in- 
teraction lay in the doctor or in the pa- 
tient. We had been keeping in mind the 
possibility that the A doctors might have 
owed their A rating to the good luck of 
getting schizophrenic patients who, for 
some reason, unknown to us, had the 
knack of establishing confidential relation- 
ships, etc., etc. Such an hypothesis had not 
seemed to us probable, but it did seem 
possible. lf f however, success in therapy 
with schizophrenic patients could be pre- 
dicted in advance, with reasonably high 
reliability, from indicators of the doctors' 
characteristics, such a result would support 
the idea that the crucial determinants of 
success lay in the doctors. 

A five-point screening device was de- 
veloped from the four vocational scores 
discussed above. The highest point (4) 



TABLE 1 

DIS1TRIBUTION OF HIGH STRONG TEST SCORES OF 26 A AND B PHYSICIANS 
USED AS BASIS FOR CONSTRUCTING A PREDICTIVE SCREEN 





No. 


Lawyer 


CPA 


Printer 


Math. Pbys. 
Sri. Teach. 


Score 


A,B+orB 


AorB+ 


AorB+ 


No. % 


No. % 


No. % 


No. % 


A physicians 
B physicians 


15 
11 


8 53% 
2 18% 


9 60% 
1 9% 


I 7% 
6 54% 


5 33% 
8 73% 
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on this screen indicates a full four-point 
matching of an individual's interest pat- 
terns with the constellation of vocations 
characteristic of the A physicians (high 
for Lawyer and CPA, low for Printer and 
Mathematics Physical Science Teacher); 
the intermediate points (3, 2, and 1) in- 
dicate matching this constellation in 3, 2, 
or 1 of these categories. And the lowest 
point (0) indicates matching in none of 
these categories. Points 4 and 3 on the 
screen (matching weighted toward the 
characteristic A physician constellation) 
would be expected to predict A physi- 
cians. Points 1 and on the screen 
(matching weighted toward the character- 
istic B physician constellation) would be 
expected to predict B physicians. Point 2 
on the screen (weighted equally between 
characteristic A and B patterns) would 
not be predictive (see Table 2). 

As indicated, this screen was originally 
developed from the Strong Test scores on 
26 physicians on whom our original 
studies of styles of clinical transaction 
were based. To check the predictive ac- 
curacy of this screen, another group of 
physicians, 46 in number, was used. 
Strong Test scores were available on each 
of these physicians. Predictions were made 
on each of them, using the screening de- 
vice, whether they would achieve im- 
provement rates of 68% or more with 



their schizophrenic patients, or not. When 
these predictions were then compared 
with the actual improvement rates 
achieved with schizophrenic patients, the 
A predictions turned out to be 80% cor- 
rect and the B predictions 67 % correct. 
More concretely, out of 25 physicians pre- 
dicted to meet the A criterion, only 5 
failed to do so; out of 12 physicians pre- 
dicted to fall below this criterion, 8 did so. 

These results thus constitute a check 
supporting the validity of the differences 
between the interest patterns of A and B 
physicians observed in the first study. 
They also support the idea that crucial 
determinants of success io the treatment 
of schizophrenic patients lie in the physi- 
cians. The duster of interest patterns 
represented by high scores for Lawyer and 
CPA and the low scores for Printer and 
Mathematics Physical Science Teacher 
presumably contain clues pointing to spe- 
cial qualities in the physician's personality 
more likely to evoke favorable clinical 
response from schizophrenic patients. And 
the inverse constellation of interest pat- 
terns presumably point to special personal 
qualities less likely to evoke acceptance as 
an effective working partner. 

One possibility to be explored is that 
individuals represented at the extreme 
points of the scale comprising this screen- 
ing device operate from an idiosyncratic 



TABLE 2 

ACTUAL PREDICTIVE CHECK ON PREDICTIVE VALUE OF SPECIAL STRONG 
VOCATIONAL INTEREST SCREEN ON NEW GROUP OF 46 PHYSICIANS 



Predictive Screen 
(High score Lawyer, CPA; 
Low score Printer, MPST) 



Scale 



Predicts 



Actual number of 
physicians qualifying 

as: 
_ __ 



A or B 



Accuracy of prediction 
(upper zone vs. lower zone) 



4 
3 


A 
A 


10 
10 


2 

3 


20/25 = 80% 



1 





B 
B 



8/12 = 
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stance in their attitudes and values and 
temperamental disposition in dealing as a 
person with their fellows; and that each 
stance is different from the other in some 
significant way which can be character- 
ized, and brought into relevance to the 
schizophrenic patient's attitudes and ex- 
pectations. For instance, the possibility 
that there may be a difference in orienta- 
tion toward the issue of "authority" be- 
tween the lawyer and the printer suggests 
itself. 

Development of A Second Predictive 
Screen 

To explore these possibilities further, a 
more detailed characterization of the per- 
sonal qualities of A and B doctors was 
attempted. This was done by examining 
their responses to each of the 400 items 
composing the Strong Inventory. As an 
initial step, a comparison was made be- 
tween the actual responses (like, indiffer- 
ent, dislike) of the original 15 A and 11 
B doctors to each item. By this procedure 
23 items were found out of the 400, to 
which A and B doctors have contrasting 
responses at levels of statistical signifi- 
cance of between .02 and .05 by the chi 
square test. 

Responses characterizing the A doctors 
(but not the B's) and those characterizing 
the B doctors (but not the A's) are listed 
in Table 3. On the basis of these findings 
a screening device was then developed 
embodying the ten starred items in the 
table. The highest point of this screen in- 
dicates a matching with characteristic A 
responses on all 10 items. The lowest 
point indicates a matching with none of 
the A responses (i.e., a matching with 
characteristic B responses on all 10 items). 
The middle point on the screen indicates 
an equal number of A and B matchings. 
And points above the middle (upper 
zone) indicate the net weighting toward 
A responses; while points below the mid- 
dle (lower zone) indicate a net weighting 
toward B responses. 



TABLE 3 

CHARACTERISTIC RESPONSES TO INDIVIDUAL 
STRONG VOCATIONAL INTEREST TEST ITEMS 
WHICH DIFFERENTIATE 15 KNOWN A PHYSI- 
CIANS FROM 11 KNOWN B PHYSICIANS; DIP- 
FERENCES ARE AT LEVELS OF STATISTICAL 
SIGNIFICANCE OF BETWEEN .02 AND .05 BY 

THE CHI SQUARE TEST 

(The * indicates items used in constructing 
the predictive screen whose performance is 
shown in the next Table) 

Responses characterizing the A doctors (but 
not the B doctors) : 

"Like" *311 President of a society or 

club 
*356a Many women friends 

"Yes" 367 Accept just criticism with- 
out getting sore 

375 Can correct others without 
giving offense 

"Dislike" 59 Marine engineer 

*60 Mechanical engineer 

*68 Photoenf raver 

*90 Specialty salesman 

94 Toolmaker 

* 1 85 Making a radio set 

"No" *368 Have mechanical ingenuity 

Responses characterizing the B doctors (but 
not the A doctors) : 

"Like" 17 Building contractor 

*19 Carpenter 

*87 Ship officer 

121 Manual training 

122 Mechanical training 
187 Adjusting a carburetor 
189 Cabinet making 

216 Entertaining others 

218 Looking at shop windows 

"Dislike" 151 Drilling in a company 

290 Interest public in a new 
machine through pub- 
lic addresses 

*381 Follow up subordinates ef- 
fectively 



Used as a predictive device, the upper 
zone would be expected to predict A 
doctors; the lower zone would predict 
B doctors; and the middle point would 
not be predictive. 
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To check the predictive accuracy of this 
screen, the second series of 46 physicians 
was again used. As shown in Table 4 the 
upper zone of the screen performed with 
77% accuracy in predicting A doctors. 
Specifically, out of 26 doctors predicted 
to meet the A criterion only 6 failed to 
do so. The lower zone of this screen per- 
formed with 83% accuracy in predicting 
B doctors. Specifically, out of 12 doctors 
predicted to fall below this criterion 10 
did so. 

It is thus apparent that this second 
screen, based on only 10 out of the 400 
items on the Strong Inventory, performs 
as a predictive device with accuracy com- 
parable to the first screen based on the 
final scores in the four vocational cate- 
gories. 

These specific items, identified in one 
series of known A and B doctors, and 
cross-validated in a second series, provide 
another set of leads for characterizing per- 
sonal qualities distinguishing A and B 
doctors, to whom schizophrenic patients 
make such a different clinical response. 



Another Validation Study 

These findings point to the presence of 
two opposite sets of qualities in the per- 
sonalities of the A and the B doctors, pre- 
sumably relevant to the marked differ- 
ences in their therapeutic results with 
schizophrenic patients. At this stage in 
the studies, the following important ques- 
tions arose: Are these results particular in 
some way to the psychiatric milieu and 
working points of view prevalent in the 
Phipps Clinic? Or do thev have a more 
general validity i.e., would doctors with 
the same differential personal character- 
istics working in any clinical setting with 
schizophrenic patients have the same kind 
and degree of differential therapeutic 
results? 

An obvious method for clarifying these 
questions is to make a study, comparable 
to that on the Phipps doctors, on a sample 
of doctors trained elsewhere and working 
with schizophrenic patients in a different 
hospital setting. If the same personal 
characteristics of the doctors were found 
to be highly associated with favorable or 



TABLE 4 

ACTUAL PREDICTIVE CHECK ON PREDICTIVE VALUE OF SECOND SPECIAL STRONG 
VOCATIONAL INTEREST SCREEN ON NEW GROUP OF 46 PHYSICIANS 



Predictive Screen* 



Scale 



Predicts 



AorB 



Actual number of 

physicians qualifying 

as: 



Accuracy of prediction 
(upper zone vs. lower zone) 



+5 


A 








+4 


A 


4 






+3 


A 


7 


1 


20/26 = 77% 


+2 


A 


7 


1 




+1 


A 


2 


4 





-1 

-2 
-3 
-4 
5 



B 
B 
B 
B 
B 



10/12 = 83% 



a Net excess of A or B matchings : Number of A minus number of B marchings divided by 2. 
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unfavorable therapeutic results as has been 
demonstrated with the Phipps doctors, 
the general validity of these particular 
variables as significant influences in the 
outcome of treatment would be supported. 

One such study on a small scale has 
been made on data provided by a neigh- 
boring psychiatric hospital. 4 This hospital 
is a completely separate institution from 
the Phipps Clinic, with its own residency 
training program, which is psychoanalyti- 
cally oriented, and with a traditional in- 
terest in the treatment of schizophrenic 
patients. Information on the improvement 
rates achieved by the individual doctors 
treating patients in this hospital was avail- 
able. Eleven doctors were selected for 
study: 5 who had met the A criterion of 
improvement rate (68% or better) and 
6 who had not met this criterion. Strong 
Vocational Interest Inventory scores were 
obtained on each of these 1 1 doctors. On 
the basis of each doctor's responses, and 
scores, on this test, his position on the 
two predictive screens was ascertained. 

The results of this procedure, using the 
first screen, are shown in Table 5. It will 
be noted that 5 of the 11 doctors fell in 



4 "We wish to thank Dr. Joseph D. Lichten- 
berg (1958) of the Sheppard and Enoch Pratt 
Hospital for his kindness in obtaining responses 
on the Strong Vocational Interest Inventory, 
and for cooperation in our studies. 



the middle, borderland group (two A's 
and three B's) which is equally weighted 
between characteristic A and B scores, 
and so is a nonpredicting zone. However, 
6 doctors were located in either the upper 
or lower zones where an accurate predic- 
tive effect is expected. It will be seen that 
the direction of prediction was accurate in 
four of the six instances, or 67%. That is, 
of 3 doctors predicted to meet the A cri- 
terion, 2 did so; and of 3 doctors pre- 
dicted not to meet this criterion, 2 failed 
to do so. 

A more striking separation of the A 
and B doctors is found by the use of the 
second screen (Table 6). With this 
screening device the separation in the 
predicted directions is clear-cut. On this 
screen, only two doctors fall in the middle 
zone (one A and one B). Of the 5 doc- 
tors whose screen position is in the upper 
zone, and who would be expected to meet 
the A criterion in actual therapeutic re- 
sults, 4 did so an 80% level of predic- 
tive accuracy. And of 4 doctors who fall 
in the lower zone, and who would be 
expected not to meet the A criterion in 
actual therapeutic results, none did so 
a 100% level of predictive accuracy. 

These results constitute supportive evi- 
dence of some general validity of the 
thesis that the crucial determinants of 
therapeutic outcome of schizophrenic pa- 



TABLE 5 

ACTUAL PREDICTIVE PERFORMANCE OF FIVE-POINT SCREEN OF 11 PHYSICIANS 
WORKING IN ANOTHER PSYCHIATRIC HOSPITAL 



Predictive screen 
(High score Lawyer, CPA; 
Low score Printer, MPST) 



Scale 



Predicts 



Actual number of 

physicians qualifying 

as: 

A B 



Accuracy of prediction 
(upper zone vs. lower zone) 



4 
3 


A 
A 


2 


1 


2/3 or 67% 


2 


AorB 


2 


3 




1 



B 
B 


1 


1 
1 


2/3 or 67% 
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tients he in certain personal qualities in 
the physician. 

It would be useful to seek further cor- 
roboration of the general validity of these 
findings, by studies of other samples of 
doctors working in several other hospitals. 
It is hoped that in time such studies can 
be carried out 

Interpretation 

Certain inferences as to the meanings 
of these findings may next be considered. 
One line of thought is that the A's with 
interests resembling lawyers 5 have a 
problem-solving, not a purely regulative 
or coercive, approach. By reason of a basic 
self-distrust, the schizophrenic patient 
does not live interdependently by give 
and take in personal leadership and in 
cultural expectations, but avoids involve- 
ment with others. In the A physician he 
would find the values of responsible self- 
determination more honored and exempli- 
fied than those of obedience and con- 



5 And CPAs whose interests correlate more 
highly with lawyers in our society than with 
teachers or printers as Strong has shown. 



formity an emphasis providing an ave- 
nue of progress out of his own entangle- 
ments in mutinous commitments toward 
authoritative influences seen as imposed 
from external sources. The A physicians, 
in their clinical styles of transaction with 
schizophrenic patients, reveal a capacity 
to be perceptive of the individualistic 
inner experiences of the patient, while 
themselves functioning in responsibly in- 
dividualistic roles. This is acceptable to 
the resentful, boxed-in patient likely to 
respond to restrictive pressures by more 
withdrawal, and to mere permissiveness 
by inertia. With the A doctors, solutions 
to the patient's problems are worked out 
through collaborative exploration of possi- 
bilities, rather than in the model of au- 
thoritative instruction. 

The B doctors, with attitudes resem- 
bling printers, or mathematics physical 
science teachers black or white, right or 
wrong are likely to view the patient as 
a wayward mind needing correction, an 
approach likely to alienate him further 
rather than intrigue him into hopeful 
effort. In the B physician the patient 



TABLE 6 

ACTUAL PREDICTIVE PERFORMANCE OF ELEVEN-POINT SCREEN ON 11 PHYSICIANS 
WORKING IN ANOTHER PSYCHIATRIC HOSPITAL 



Predictive screen* 



Scale 



Predicts 



Actual number of 

physicians qualifying 

as; 



Accuracy of prediction 
(upper zone vs. lower zone) 



+5 


A 






+4 


A 1 






+3 


A 


1 


4/5 or 80% 


+2 


A 1 






-HI 


A 2 









AorB 1 


1 




-1 


B 


3 




-2 


B 


1 




-3 


B 




4/4 or 100% 


-4 


B 






-5 


B 







a Net excess of A or B matchmgs: Number of A minus number of B marchings divided by 2. 
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would find an emphasis on value systems 
weighted more heavily toward deference 
and conformity to the way things are. The 
particular rigidity of attitude implied by 
their mechanically inclined interests and 
orientation toward precision and a rule 
of thumb approach probably constitutes 
an actual hindrance to the development 
of self-trust and social spontaneity in the 
schizophrenic patient. 

Physicians whose attitudes tend to ex- 
pect and respect spontaneity tend to evoke 
self-respectful social participation more 
effectively than those whose attitudes tend 
to restrict spontaneity by preference for 
conventionalized expectations. This ap- 
pears to be the basic difference in attitude 
between A and B physicians. 

Although the emphasis in this discus- 
sion has been on contrasts between A and 
B physicians, it is evident from our data 
that there is a borderland group suggest- 
ing that some physicians might move 
from a B position to an A position in 
their therapeutic performance, if appro- 
priately informed and motivated, and that 
guidance along the lines of interpretation 
which have been presented can improve 
therapeutic effectiveness with schizo- 
phrenic patients. 

PART II. MODES OF RESEARCH IN 
PSYCHOTHERAPY 

The challenge in bringing scientific 
appraisal to bear on the psychotherapeutic 
process is to develop working viewpoints 
and procedures appropriate to the nature 
of the phenomena involved. The signifi- 
cant data in the field of clinical psychiatry 
are often inferential in character. Under- 
lying human themes and issues giving rise 
to certain symptoms and patterns of be- 
havior must be sought and identified 
through dues provided by such phe- 
nomena as attitudes, values, and expecta- 
tions in the patient and in other significant 
persons in his life. Scientific efforts to 
shape this "human material" into work- 
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able data are relatively recent. Human 
problems and motivations were depicted 
successfully and eloquently in literary pro- 
ductions (novels and plays) long before 
they attracted the serious attention of 
psychologists and physicians. The scien- 
tific investigator has the task of dealing 
with this human material with a percep- 
tiveness equal to that of his literary col- 
leagues, and of transmuting it into com- 
municable form which lends itself to 
scientific manipulation. 

This is probably still best done by a 
qualitative scientific approach in which 
the investigator uses his own human per- 
ceptiveness and imagination, channeled 
by his intelligence, as the surest means for 
localizing and differentiating that which 
is trivial and that which is truly basic and 
central. The first task, certainly, is to seek 
to understand where the important phe- 
nomena lie and to attempt to characterize 
some of them in workable form. Quantita- 
tive methods are probably more useful in 
developing than in originating under- 
standing and hypotheses. Quantitative 
methods are indispensable aids at the right 
time sorting, counting, testing for the 
significance of differences, and in cross- 
validation and prediction studies. They 
supplement, but do not substitute for, the 
curiosity and imagination of the investi- 
gator who, himself, is a major instrument 
in his research. 

Although the ultimate "productions" of 
scientific efforts have general and objec- 
tive validity, the process through which 
they arise, and the means devised and 
selected to bring them to independent 
existence, take place within the mind and 
personality of the individual scientist. He 
is the source of new angles, new problems 
and possibilities, and new solutions. The 
subjectivity of the investigator as a scien- 
tific asset, and not just a liability, is some- 
times not fully appreciated. Subjective in- 
volvement, necessarily strong in studies 
of one's fellow beings, may lead into ob- 
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jective errors. But these are likely to be 
temporary, for they are subject to correc- 
tion from several sources: the investi- 
gator's own intellectual integrity and self- 
critique; the consensus of his colleagues; 
and success or failure in replication of his 
findings by others. 

The general problem of "objectivity" in 
scientific research is clarified, if not sim- 
plified, in the principle of relativity which 
calls to attention the mutual relationship 
between the observer and the events which 
he is observing. It is possible, for instance, 
to view schizophrenic phenomena from 
points of view other than the therapeutic, 
e.g., etiologic, psychologic, ontogenic, 
psychoanalytic, existential, organic, etc. 
Inquiries carried out from these diverse 
points of view would presumably produce 
a series of different formulations of 
schizophrenic phenomena, each relevant 
to the angle from which it is observed. 
Similarly, different investigators, working 
from the same angle of focus, may see and 
report things differently because of varia- 
tions in their own inner talent and per- 
ceptiveness. In psychotherapy, particularly 
where the investigator is working as a 
participant observer with the patient, vari- 
ations in observation may also reflect 
actual differences in the behavior of pa- 
tients who may respond in one way in 
relation to one partner, and in quite a 
different way to another. This is relevant 
to the different ways that A and B doctors 
approach the treatment of the schizo- 
phrenic patient. 

In research in psychotherapy, the points 
of view of investigators, even about 
psychotherapy, may introduce variations 
in what is looked for and what is ex- 
cluded. Similarly, points of view about 
what constitutes favorable or unfavorable 
patient outcome may vary, so that in one 
case certain criteria are accepted or re- 
jected which are not similarly accepted or 
rejected by others. 

Differences between formulations of 



different investigators are therefore not 
necessarily to be explained, as sometimes 
happens, on the basis that only one is 
correct and the other is m error. Rather, 
in the absence of error, these differences 
reflect differences in the angle of focus of 
the observers or differences in their sub- 
jective modes of processing what they see, 
rather than in the phenomena observed. 
"Objective" (invariant) formulations of 
the events observed can be approximated 
only by taking these modifying transfor- 
mations into account. 

Such differences are inevitable and per- 
haps even desirable. But it seems essential 
for each investigator to state as dearly as 
he can the angle from which he is work- 
ing, and the concepts and criteria which 
he is employing. He can then adhere to 
his own individual approach, and at the 
same time appraise his colleagues' findings 
in the context in which they were made. 
Different observations, made from differ- 
ent points of view, with scientific appre- 
ciation of the variations in the viewpoints, 
may contribute richly to the development 
of an accurate body of knowledge about 
the general problems with which all are 
concerned. 

Minimum Requirements for Research in 
Psychotherapy 

The concept of "psychotherapy," if kept 
too abstract, can lead to needless pitfalls 
or ambiguity. Ambiguity can be reduced 
by focusing on the following specific con- 
siderations: "Psychotherapy of whom?" 
"By whom?" "To what end?" Although 
the goals in studying psychotherapy may 
vary in a wide range, the goal of psycho- 
therapy itself seems simply stated: to 
assist a patient with a psychiatric dis- 
ability to a state of improved well-being. 
That is, the purpose of psychotherapy is 
favorable patient outcome. Success in 
efforts to achieve this purpose, the pro- 
cedures taken toward it, even concepts of 
what "it" is may vary. But it is the pres- 
ence of this purpose that determines that 
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a "psychotherapeutic situation" exists. The 
nature of a two-person professional rela- 
tionship is intrinsically distinguishable as 
one that is "psychotherapeutic" or one 
that is "nonpsychotherapeutic" by whether 
this purpose is present or absent. 

Minimum requirements for research in 
psychotherapy, therefore, include a focus 
on three basic variables: (a) the patient, 
(&) the therapist (as the focal point of 
the therapeutic situation), and (c) pa- 
tient outcome. Each of these variables will 
now be discussed in some detail. 

a. The Patient. "Psychotherapy," like 
"surgery" or "medical treatment" etc., 
may be discussed in very general terms in 
respect of its common denominators for 
any patients regardless of the specific na- 
ture of this patient's disability. It is some- 
times even discussed in such general terms 
as "a psychiatrist functioning," as though 
there were "a" mode or method of be- 
having or a "technic" which constitutes 
"psychotherapy." However, in a considera- 
tion of the actual functioning of the doc- 
tor the nature of the clinical problem is an 
essential concern. It is the specific nature 
of the problem which determines what 
the doctor does, how he does it, and why. 

In studying psychotherapy from a re- 
search point of view, it is of the greatest 
importance to take the patient variable 
into clear account. Studies of psycho- 
therapy focused on varying conditions in 
the treatment situation and on the doc- 
tor's behavior, with patient outcome used 
as the criterion for comparing and con- 
trasting the effectiveness of therapeutic 
conditions, will be meaningful only if the 
patients being treated are controlled for 
homogeneity. The most technically care- 
ful studies of the treatment situation and 
of patient outcome, if the patients being 
treated represent a variety of clinical and 
personal problems, will have low scientific 
validity as a study of "psychotherapy." In 
this line of reasoning, the finding, as in 
our studies that certain conditions in the 
treatment situation facilitate favorable 
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outcome for the schizophrenic patient, 
does not provide any basis for general- 
izing that these same conditions will have 
any significant effect in determining out- 
come in other kinds of clinical problems, 
for example, in depressed or neurotic 
patients. 

Even among patients selected for homo- 
geneity along broad diagnostic lines, a 
fairly wide variation will be found. How- 
ever, this variation is likely to be around 
a common theme, rather than in number 
and kind of themes. This kind of variation 
can be controlled by insuring randomiza- 
tion between any two groups who are 
being compared. This was done early in 
our studies by showing that the one group 
of doctors did not have "easier cases," but 
that the range of clinical variation in the 
patients treated by the A and by the B 
doctors was comparable. 

It wiE be recalled that, whereas the A 
doctors were almost three times as effec- 
tive as the B doctors in treating schizo- 
phrenic patients, both doctor groups 
achieved comparable results with de- 
pressed and neurotic patients. These find- 
ings underscore the importance of a care- 
ful designation of who is being treated 
in research studies in psychotherapy. 

b. The Therapist. The therapist is the 
next important variable to be considered 
in connection with research in psycho- 
therapy. The effective treatment of a 
psychiatric patient is a complex profes- 
sional responsibility. The psychiatrist 
undertakes it with a background of train- 
ing designed to equip him to appraise the 
ramifying expression of emotional and 
meatal disturbance at somatic as well as 
behavioral levels; and to draw from the 
broad range of therapeutic armamentari- 
um measures of treatment which can 
supplement and facilitate the psycho- 
therapeutic task For the purpose of the 
present discussion, other modes of treat- 
ment of psychiatric patients than psycho- 
therapy will be excluded from the discus- 
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sion, although they are many. At the 
Phipps Clinic they are drawn on as seems 
clinically indicated, but regarded as ad- 
junctive to the psychotherapeutic task. 

In this discussion I shall not include a 
review of the range of concepts which 
have developed about the role of the 
psychotherapist and about psychothera- 
peutic techniques. For present purposes, I 
shall limit myself to that aspect of the 
therapist variable which is the particular 
topic of attention here. This is the possi- 
bility, supported by the Phipps studies on 
the treatment of the schizophrenic patient, 
that the personality of the therapist may 
be an important therapeutic factor. Scien- 
tific interest in studying whether and how 
this is so seems to be growing. Methodo- 
logical problems for carrying out studies, 
using actual doctors treating actual pa- 
tients whose clinical outcome could be 
evaluated, have been found difficult to 
solve. This undoubtedly accounts for the 
absence of other studies comparable to 
those which Dr. Whitehorn and I have 
been carrying out at the Phipps Clinic 
where facilities for overcoming many of 
the obstacles have been relatively favor- 
able. However, "meanwhile" studies of 
psychiatrist's personalities have been at- 
tempted by ingenious methods, such as 
supervisor's ratings of residents, self- 
descriptive Q sorts, and demonstrations of 
differences in response among psychia- 
trists exposed to the same interviewing or 
clinical situations. 6 Studies of this sort 
have demonstrated that psychiatrists vary 
in their personal characteristics and modes 
of clinical functioning. It has apparently 
not yet been possible to evaluate these 
differences for their possible relevance to 
therapeutic effectiveness with actual pa- 
tients. 

c. Patient Outcome. The purpose of 



6 Studies by Holt and Luborsky (1958), 
Knupfer, Jackson, and Krieger (1959), Raines 
and Rohrer (1955), Strupp (1958), and 
Uhlenhuth, Canter, and Neustadt (1959) are 
examples. 



psychotherapy is favorable patient out- 
come. Since the broad aim of research in 
psychotherapy is to clarify what condi- 
tions in the treatment situation facilitate 
favorable patient outcome for specific pa- 
tients, actual outcome is the essential, 
logical criterion for evaluating what con- 
ditions are or are not effective in psycho- 
therapeutic effort. In reference to this 
methodological point, it is of interest to 
note that the studies from the Phipps 
Clinic are the only ones in the literature 
in which patient outcome is used as the 
criterion of what conditions are effective 
or ineffective in the psychotherapy of 
schizophrenic patients, 7 This criterion 
needs to be used more extensively and 
can be used when research studies are 
carried out on actual psychiatric patients 
in a hospital setting. Because of the im- 
portance of this variable for sound re- 
search in psychotherapy, I should like to 
consider it in some detail. 

In order to use the criterion of patient 
outcome, two conditions are necessary. 
One is that a sufficient number of pa- 
tients, at the termination of treatment, 
must be represented in each of the two 
outcome groups: "improved" and "unim- 
proved" to make comparisons and con- 
trasts possible. Most neurotic patients 
tend to improve, at least symptomatically, 
in a variety of treatment situations. The 
improved group, with these patients, is 
therefore likely to be embarrassingly high 
for research purposes. Schizophrenic pa- 
tients, in contrast, are notoriously not self- 
curing. Since few schizophrenic patients 
improve without therapeutic intervention, 
and sometimes not readily then, the im- 
proved group here may be embarrassingly 
low for research purposes. However, when 
improvement does occur the presumption 

7 Frank and his associates have v sed this 
criterion in studies of psychotherapy carried out 
in the Phipps Outpatient Department (Imbet 
et aL, 1957; Gliedman et al, 1957; Frank et 
al., 1957; Gliedman et al., 1958; Frank et aL, 
1959). 
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is that treatment has had something to do 
with the favorable outcome. Conversely, 
when improvement does not occur, the 
presumption is that conditions facilitating 
good therapeutic outcome have been lack- 
ing, or that the conditions present had a 
hindering effect, or no effect at all on good 
therapeutic response. 

The situation at the Phipps Clinic has 
been relatively favorable for scientific pur- 
poses in respect of this condition, as is 
shown in Table 7. An expectation of 
about 50% favorable response was real- 
istically justified by the actual results dur- 
ing the early years of the studies. In more 
recent years this expectation has risen to 
about 75%. Actually, at present, the num- 



TABLE 7 

NUMBER OF SCHIZOPHRENIC PATIENTS DIS- 
CHARGED, NUMBER IMPROVED, AND PERCENT 
IMPROVED EACH YEAR FROM 1944 THROUGH 
1959 

(The difference in improvement rates between 

the first 8-year period and the second 8-year 

period is significant, by the chi square test, well 

below the .001 level) 



Year 


No. of 
Patients 


Improved 


No. 


Percent 


1944 
1945 
1946 
1947 
1948 
1949 
1950 
1951 


47 
49 
55 
44 
55 
51 
61 
59 


24 
21 
27 
24 
20 
20 
31 
34 


51% 
43% 
49% 
54% 
37% 
39% 
51% 
57% 



Total 



421 



201 



1952 
1953 
1954 
1955 
1956 
1957 
1958 
1959 



79 
60 
42 
47 
38 
37 
72 
57 



52 
37 
30 
36 
31 
30 
57 
41 



77% 
82% 



Total 



432 



314 



bers of unimproved patients are reaching 
somewhat unfavorable proportions for 
research purposes. In connection with this 
table, it is interesting to note that the im- 
provement rate for schizophrenic patients 
during the first eight years listed was 
48%, while the improvement rate during 
the last eight years was 73%. The level of 
statistical significance of this difference, 
by the chi square test, is well beyond the 
.001 level. In this connection it may be 
interesting to know that during the second 
eight-year period there were twice as 
many doctors as during the first eight-year 
period whose Strong Test scores matched 
with the characteristic constellation of in- 
terests of A doctors (see Table 8). 

A second condition in using patient 
outcome as a criterion is that of having 
acceptable means for judging that patients 
are, in fact, improved and of demonstrat- 
ing in what way they are improved. Al- 
though universally accepted "objective" 
criteria of what constitutes "improve- 
ment'* do not yet exist, this does not mean 
that valid judgments cannot be made. This 
is particularly the case with psychotic 
patients in whom changes for the better 
are often dramatic and clear-cut, both to 
the patients themselves and to objective 
observers. In most patients there is little 
practical difficulty in making a distinction 
between "improved" and "unimproved" 
when actual favorable changes are taking 
place. Considerable attention has been 
given in our studies to establishing the 
validity of the judgment that a patient is 
"improved." The appraisal of the patient's 
condition at discharge is made not only 
by the physician who treated him, but 
also by the senior resident psychiatrist and 
by the psychiatrist-in-chief. Any personal 
bias of the individual physician is thus, 
presumably, subject to correction by the 
clinical judgment of more objective ob- 
servers. Further evidence, still more ob- 
jective in nature, was sought from the 
following sources: (a) the disposition of 
the t>atient at the time of discharge 
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whether to the community or to another 
hospital; (b) evidence of increased par- 
ticipation in social relationships with 
other patients, as recorded in daily notes 
kept by the nurses; (c) increased partici- 
pation in the clinic activity programs, as 
recorded in nursing and occupational 
therapy reports, and (d) changes in be- 
havior chart markings. The Behavior 
Chart is a graphic chart for demonstrat- 
ing change in a patient's behavior which 
merits respect as a scientific instrument 
in research in psychotherapy. The nurses' 
daily observations of the patient are re- 
corded on this chart, supplemented by de- 
scriptive notes of the patient's behavior. 
These charts have been kept in the Phipps 
Clinic since 1914, and have proved sensi- 
tive indicators of the changes in the pa- 
tient's behavior, both in favorable and 
unfavorable directions. Since they are kept 
by the nurses, they provide another record 
of observation of the patient during his 
hospitalization, independent of the physi- 



cian's judgment. Items marked on the 
chart are organized in four zones accord- 
ing to whether they characterize normal, 
overactive, underactive, or "odd" behavior 
( hallucinations, delusions, mannerisms, 
etc.). We have used the Behavior Chart 
quantitatively by counting the number of 
markings in each of the four behavior 
zones during the first ten days after ad- 
mission and the last ten days before dis- 
charge and noting the direction of the 
shift. These data disclosed differences be- 
tween the "improved" and "unimproved" 
patients in a direction favorable to the 
"improved" patients at levels of signifi- 
cance, by the chi square test, ranging be- 
tween .02 and .001. The reliability of the 
clinical appraisals of the patient's prog- 
ress is thus supported. 

Q sorts and other psychological tests 
have been avoided in the studies of the 
schizophrenic patients, since they require 
patient cooperation which is often quite 
unreliable in the early psychotic stages of 



TABLE 8 

DISTRIBUTION ON FIRST SPECIAL STRONG VOCATIONAL INTEREST SCREEN OF DOCTORS TREATING 

SCHIZOPHRENIC PATIENTS FROM 1944 THROUGH 1959, BY EIGHT-YEAR PERIODS 
(The differences in percent of doctors with interest patterns like known A doctors in the two 
eight-year periods is at the .01 level of significance by the chi square test.)* 



Predictive screen 
(High score Lawyer, CPA; 
Low score Printer, MPST) 



1944-1951 



1952-1959 



No. 



Percent 



No. 



Percent 



Scale 



Predicts 



4 
3 


A 
A 


12 29% 


34 60% 



AorB 



10 



25% 



10 



17% 



B 
B 



19 



13 



Total 



41 



57 



*In the 1944-1951 period, scores are not available on 20 doctors who were residents before 
the Test was used systematically for research purposes; in the 1952-1959 period scores are avail- 
able on all but 2 doctors. (The possibility of some reason for a bias in the selection of doctors for 
testing in the 1944-1951 period, so that A doctors would be unduly represented in those for whom 
Strong Tests were available, was considered. Such a bias could not be located. Even if all 20 
untested doctors were A doctors, which seems unlikely, the percentage would be less than in the 
1952-1959 period 50% vs. 60%.) 
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treatment. It is possible, however, that 
appropriate techniques for the special 
situation presented by the study of psy- 
chotic patients can be developed. 

In addition to establishing that im- 
provement had occurred, and the fre- 
quency of improvement, it is also possible 
to characterize the quality of improve- 
ment made by schizophrenic patients. In 
the Phipps studies, quality of improve- 
ment has been evaluated under three gen- 
eral headings or grades of improvement: 
Grade I symptom decrease only; Grade 
II symptom decrease and increase in 
personal effectiveness; and Grade III 
symptom decrease, increase in personal 
effectiveness, and progress in personal 
problem solving. 

These three grades of improvement 
seem to correspond with three consecutive 
phases of progress made by the schizo- 
phrenic patient during the course of treat- 
ment. Each phase represents a step toward 
the ultimate resolution of the personal 
problem generating the patient's psychotic 
reaction. These three phases of treatment 
were noted a number of years ago (Betz, 
1947) and designated in the following 
way: Phase I timid rigidity, Phase II 
spontaneity in mutual interaction, and 
Phase III broadened social participation. 

Some patients take only the first step, 
during their psychotherapeutic experi- 
ence, and may be said to have reached a 
Grade I level of qualitative improvement 
Some patients progress further and ac- 
complish the second step a Grade II im- 
provement. Other patients (mostly those 
treated by A doctors) progress still fur- 
ther, achieving a radical reorientation of 
their attitudes toward themselves and 
others what we have called personal 
problem solving or a Grade III improve- 
ment. 

This step-wise course does not seem to 
follow a random path, but moves along 
the central axis of the "authority" issue 
which seems to constitute a basic personal 
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problem in the schizophrenic patient. As 
already described, the prevalent (but 
hated) schizophrenic assumption is that 
authority and power lie in others, not in 
the self. The more this issue is dominant, 
the more marked is the patient's state of 
passivity, lack of initiative, fearful dis- 
trust of the self and others, withdrawal, 
and delusional and hallucinatory sense of 
being controlled by outside forces, and 
the more relationships with others tend 
to be reduced to watchful waiting in an 
attitude of fatalistic resignation. The first 
problem to be solved through the treat- 
ment experience and this is done in 
Phase I if at all is the achievement of a 
mutually confidential relationship between 
patient and doctor, and the replacement 
of mistrustful psychotic aloofness by trust- 
ful dependence. This step is not readily 
accomplished with schizophrenic patients, 
particularly by the B doctors. It represents 
a decrease in alienation and is accom- 
panied by a decrease in psychotic symp- 
toms, but not immediately by increased 
social activity. 

The next problem to be solved and 
this is done in Phase II if at all is that 
of where "authority" is to lie in others, 
even the doctor who is now trusted or 
in one's self. This step is not readily ac- 
complished either, particularly by the B 
doctors who are likely to fall into the role 
of benign authority figures. Given suffi- 
cient leeway and support to do so, many 
schizophrenic patients take this step to- 
ward the solution of their problems, and 
accept the responsibility for self-deter- 
mined action. This step constitutes a 
growth in self-respect and confidence, and 
is accompanied by an increase in social 
effectiveness and participation, readily 
observed. 

The final problem to be worked out 
accomplished in Phase III of treatment 
is that of getting personally involved in 
real life situations, with choices and ac- 
tions based on self-determined planning 
and implemented through consultative 
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help from others. It is accompanied by 
broadened social participation, and by a 
decreased need for consultation and sup- 
port from the doctor. 

This brief perspective on phases of 
treatment and grades of improvement of 
schizophrenic patients has been derived 
from a study of the clinical progress of 
actual patients. It provides a schematiza- 
tion which can serve two functions. It 
represents a progress continuum for 
locating the point at which a patient is 
functioning at a given period of time in 
his treatment, in terms of clinical mani- 
festations, of social participation, and of 
his attitudes on the problem of "authority" 
as displayed in his interactions with the 
doctor. It also provides criteria for esti- 
mating the relative degree and quality of 
improvement which he has reached when 
treatment is terminated, for whatever rea- 
son. This schematization does not pretend 
to be a complete or final map of what 
"really" takes place in the psychothera- 
peutic changes which occur in schizo- 
phrenic patients. It is an example of an 
attempt to rough in and bring together 
in an orderly sequence some of the phe- 
nomena which have been repeatedly ob- 
served. It is a tentative schematization 
subject to revision and supplementation. 
It is a kind of effort, however, which may 
prove useful in studying the issues in- 
volved and the sequence of events in the 
psychotherapy of patients other than 
schizophrenic 

Thus, psychotherapeutic change is con- 
ceived as the solution of specific personal 
problems and the activation of latent 
inner potentialities for more healthy func- 
tioning, brought about through meaning- 
ful human experience provided along spe- 
cific lines through the relationship with 
the therapist. For the schizophrenic pa- 
tient this is a profound, personal experi- 
ence, superseding that with any previous 
interpersonal partners. It is customarily 
an absorbing professional experience for 
the doctor. It is the goal of research in 



psychotherapy to contribute to a body of 
knowledge about how these profound 
changes can be brought about so that they 
can be produced by more doctors for more 
patients with a high probability of success. 
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The Therapist as a Social 
Reinforcement Machine 1 

LEONARD KRASNER, PH.D 



In recent years the therapist has 
emerged, reluctantly, from the shadow of 
the patient to a fuller recognition of the 
influence of his behavior in the psycho- 
therapy process. Certain assumptions are 
implicit in the selection of the type of 
research studies used to illustrate the 
major issues in research on the therapist 
variable in the psychotherapy process. 
These assumptions may be stated as fol- 
lows: (a) Psychotherapy is a lawful, pre- 
dictable, and directive process which can 
be investigated most parsimonously with- 
in the framework of a reinforcement 
theory of learning, (b) The variables 
which affect the therapy process are the 
same as those in other interpersonal situa- 
tions which involve the reinforcement, 
control, manipulation, influencing, or re- 
direction of human behavior. 

If these general assumptions about 
psychotherapy are accepted, a number of 
deductions follow which can guide re- 
search programs: (a) The therapist, as 
the central variable in the therapeutic 
situation, is a social "reinforcement ma- 
chine," programed by prior training and 
experience. The therapist has been trained 
to use his behavior as a decisive factor in 
interpersonal situations with individuals 
who come to him for assistance. His goal 

1 From the Behavioral Research Laboratory, 
VA Hospital, Palo Alto. The preparation of 
this paper was facilitated by support, in part, 
from Research Grant M-2458 from the Na- 
tional Institute of Mental Health, Public Health 
Service, through Stanford University. The au- 
thor wishes to express his appreciation to his 
colleagues Leonard Ullmann, Robert Weiss, 
and Paul Ekman for their valuable assistance 
in the conception, design, and analysis of data 
of the various studies in this project. 



is to influence his patient's behavior in 
the therapy situation so that certain 
changes may occur in the patient's total 
life situation, (b) The therapist has avail- 
able to him a series of reinforcement tech- 
niques to influence the probability of 
selected behavior change in the patient. 
(c) The effectiveness of the reinforce- 
ment process can be maximized by appro- 
priate interactions of the therapist, situa- 
tional, and patient variables. 

It is difficult to find an area of human 
endeavor whose effectiveness is as strongly 
defended with as little concrete evidence 
as "psychotherapy" (Eysenck, 1952). It 
is increasingly difficult for research in this 
field to break out of the confines of the 
narrow boundaries of the framework of 
traditional psychotherapeutic interaction. 
Research in psychotherapy will not be as 
productive as it could be until the thera- 
pist can accept his role as an influencer of 
behavior and thus permit investigation of 
the variables of behavior control. Within 
this concept, new approaches and new 
techniques can develop. Further, we will 
be able to develop predictive devices for 
evaluating the changes in behavior which 
may result from such techniques. 

To put into proper perspective the 
variables of the therapy process, we must 
investigate relevant research in a number 
of related fields, in addition to traditional 
psychotherapy research. This should in- 
clude other "influencing" processes such 
as: "brainwashing," hypnosis, "placebos," 
role-taking, sensory deprivation, attitude 
influence, verbal operant conditioning, 
motor operant conditioning, and sub- 
liminal perception. The process of psycho- 
therapy is an integral part of a broader 
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psychology of behavior control (Frank, 
1961; McConnell 2 ; Meerloo, 1956; Rotter, 
I960; Sargant, 1957). 

In recent years, this point of view has 
become increasingly prominent in a wide 
range of both theoretical and research 
papers. A series of earlier papers and 
books had placed psychotherapy within 
the framework of learning or social rein- 
forcement theory (Dollard & Miller, 
1950; Mowrer, 1953; Schaffer & Lazarus, 
1952; Shaw, 1948; Shoben, 1949). How- 
ever, learning theory approaches usually 
limit themselves to the reinterpretation 
or translation of the ongoing therapy 
process into learning theory terminology, 
and as such, offer bttie in the way of rele- 
vant new research techniques into the 
process. More recent works ( Bachrach, in 
press; Bandura, 1961; Frank, 1958, 1959a, 
1961; Kanfer, 1961; Krasner, 1955; Lun- 
den, 1961; Marmor, 1961; Salzinger, in 
press; Shaw, 1961) have moved sharply 
ia the direction of interpreting the thera- 
pist as one who manipulates and controls 
the therapy situation by his knowledge 
and use of learning techniques in a social 
reinforcement situation. This approach to 
psychotherapy research is implicit in ver- 
bal operant conditioning studies (Krasner, 
1958a; Salzinger, 1959) which have been 
strongly influenced by the work of Skinner 
(1953a, 1953b, 1957, 1958), and Keller 
and Schoenfeld (1950). These studies 
have features in common that distinguish 
them as a unique body of research. In 
verbal operant conditioning, S is required 
to emit verbal behavior as part of a given 
task, and E reinforces a preselected class 
of $'s verbal behavior by carefully con- 
trolled verbal and/or nonverbal behavioral 
cues. The conditioning of verbal behavior 
is developing as a major technique for 
systematically exploring variables of inter- 
personal situations. Relevant studies will 
be cited as they illuminate the psychology 
of behavior control. 

2 McConnell, J. V. Persuasion and behav- 
ioral change. Unpublished manuscript, I960. 
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Historically, in the conceptualization of 
therapy, major emphasis was placed on 
the role and attributes of the patient, with 
relatively little regard for the therapist's 
characteristics, except that he be a well- 
trained person who was warm and "ac- 
cepting." If anything, the therapist varia- 
ble was to be controlled by removing the 
therapist's personality from the therapy 
situation by his own analysis, which would 
dear him of any involvement or "illegal" 
influence on the patient. Even the seating 
arrangements, with the therapist located 
behind the patient on the couch, was cal- 
culated to take the therapist "out" of the 
situation. Then, later writers began to 
push the therapist back into the therapy 
situation by emphasis on the "relation- 
ship," or the therapist role as a "partici- 
pant observer" (Sullivan, 1947). The cur- 
rent reinforcement viewpoint de-empha- 
sizes the uniqueness of the role of the 
patient, while pushing to the fore the role 
of the therapist and his interaction with 
the patient. 

In the literature, there is a growing ac- 
ceptance of the therapist as being in a 
controlling role. For example, Rogers 
(Rogers & Skinner, 1956) is willing to 
concede, perhaps reluctantly, that "in 
dient-centered therapy, we are deeply en- 
gaged in the prediction and influencing 
of behavior, or even the control of be- 
havior. As therapists, we institute certain 
attitudinal conditions, and the client has 
relatively little voice in the establishment 
of these conditions. We predict that if 
these conditions are instituted, certain be- 
havioral consequences will ensue in the 
dient." Haley (1959) interprets psycho- 
analytical psychotherapy as being a "con- 
trolling type of therapy/' He suggests that 
"the therapist must take control of what 
happens in his relationship with the pa- 
tient," and "to control a relationship a 
person must be in a position to establish 
the rules for what is to happen between 
himself and another person." Haley cites 
the works of Lindner, Rosen, and Erikson 
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as examples of what he calls "New Style 
Directive Therapy." 

Thus, from two "schools" which might 
be expected to refuse to acknowledge that 
all psychotherapy is directive in nature, 
the "nondirective" and the "psychoanalyt- 
ical," there is tacit recognition from at 
least some writers of the controlling 
aspects of the therapist's behavior (Mar- 
mor, 1961 ). Rogers, however, in his sym- 
posium discussion with Skinner (1956), 
contends that the therapist's goal is to 
establish a self-directing or self -controlling 
patient. Skinner, on the other hand, feels 
that this is unrealistic, and that the con- 
trolling forces on the patient will con- 
tinue to come from the patient's environ- 
ment. 

Gill and Brenman (1948) point out 
that the "raw data in psychotherapeutic 
research is inevitably influenced by the 
therapist's views ... the subtleties of 
showing interest in certain kinds of ma- 
terial, often not consciously detected 
either by therapist or patient, are mani- 
fold. This may include a questioning 
glance, a shifting of visual focus, a well- 
timed *mm-hmm,' a scarcely perceptible 
nod, or even a clearing of the throat. The 
therapist's conception of what his inter- 
personal relationship with a patient should 
be will also seriously influence the kind 
of material he obtains. If one therapist 
believes he should be 'friendly' and an- 
other that he should be 'distant/ the raw 
data obtained by each will obviously 
differ." 

Therapists have usually recognized that 
they are dealing primarily with "talk," 
"word." Shaffer and Lazarus (1952) 
point out that "the techniques of getting 
the patient to talk and to continue to talk 
must be the real core of the treatment." 
Verbal behavior can be approached system- 
atically in research with the advent of 
verbal conditioning techniques and other 
techniques of analyzing of verbal be- 
havior, such as content analysis (Murray, 



1954; Auld & Murray, 1955; Auld & 
White, 1959); grammatical characteriza- 
tions (Goldman-Eisler, 1952, 1954; Lor- 
enz & Cobb, 1953); word-counting and 
verbal input-output procedures (Mowrer, 
195 3a; Lennard, Calogeras, & Hendin, 
1957); interaction chronographs (Saslow 
Matarazzo, 1959); and others (Bales, 
1950; Dibner, 1956; Dittmann, 1952; 
Glad, 1959; Grossman, 1952; Leary, 1957; 
MahJ, 1956, 1959; Palmore, Lennard, & 
Hendin, 1959; Starkweather, 1956a, 
1956b; Whitehorn & Betz, 1954). Fur- 
ther, Skinner's (1957) definition of ver- 
bal behavior as "behavior reinforced 
through the mediation of other persons," 
points up the social learning involved in 
verbal behavior and places it squarely 
within the bounds of a reinforcement 
approach to psychotherapy research 
(Bachrach, in press; Kanfer, I960; Kras- 
ner, 1955; Salzinger, in press). 

If we are to conceive of psychotherapy 
as a process involving reinforcement pro- 
cedures, then the major research task is to 
investigate the conditions under which 
the reinforcement procedure is most effec- 
tive. These variables involved can be con- 
sidered under three categories: (a) varia- 
bles related directly to therapist character- 
istics, () situational variables, (c) 
therapist-patient interaction variables. 

The "therapist characteristics" variables 
include: (a) the personal characteristics 
of the therapist, such as sex, personality, 
prestige, and socioeconomic status, (b) 
the specific influences on the therapist's 
concept of his role, such as his value and 
ethical system, and his formal and in- 
formal training, (c) the special tech- 
niques used by the therapist. The situa- 
tional variables include the environmental 
setting and "atmosphere" in which the 
reinforcement process is taking place. The 
interaction variables are the result of the 
interaction of the therapist behavior with 
various characteristics of the patient popu- 
lation, such as diagnostic category, per- 
sonality, response class, and awareness. 
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Personal 

The effectiveness of the interpersonal 
influencing process is related directly to 
the personal characteristics of the "influ- 
encer." These characteristics include: age, 
sex, personality, appearance, voice quality, 
prestige, and socioeconomic status. These 
are all characteristics that can be varied, 
and can be interrelated with variables of 
the situation and of the "influencee" to 
determine most effective reinforcement 
combinations. 

Personality. The literature is replete 
with literally hundreds of adjectives de- 
scriptive of the personality of the ideal 
therapist. However, the number of re- 
search studies investigating the influence 
of therapist personality upon patient be- 
havior is relatively small. The usual ap- 
proach involves investigation by content 
analysis of correlational relationships be- 
tween: (a) therapist personality char- 
acteristics, such as "warmth," "conflict," 
or "anxiety level," and (b) aspects of pa- 
tient behavior, such as "staying in therapy" 
or "expressions of hostility" (Aronson, 
1953; Bandura, 1956; Cutler, 1958; Fied- 
ler, 1953; Ford, 1959; Hiler, 1958; Par- 
loff, 1956). 

Another research approach to the in- 
vestigation of the interpersonal influenc- 
ing process has been that of verbal operant 
conditioning. This approach is poten- 
tially more productive than content analy- 
sis approaches because of the ability to 
manipulate experimental variables, and to 
break out of the confines of the circularity 
of reasoning inherent in the more tradi- 
tional "protocol" bound investigations. 

For example, verbal conditioning studies 
have been used to explore the differences 
in E characteristics as they differentially 
affect S behavior. Binder, McConnell, and 
Sjoholm (1957) found differences in the 
effectiveness of two Es who differed 
sharply in physical, sexual, and personality 
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characteristics. An attractive appearing, 
petite, female was significantly more effec- 
tive in conditioning hostile words than a 
husky, ex-Marine male, although both 
were able to achieve conditioning. Fergu- 
son and Buss ( I960) follow up the study 
by Binder by using a male and female E 
reinforcing hostile words. These Es varied 
their behavior to the Ss and found that it 
was the aggressiveness, not the sex, of E 
that led to significant differences in S*s 
responsivity. In both studies the differ- 
ences in effectiveness were hypothesized 
to be related to specific differences in 
physical characteristics of E. In contrast, 
Matarazzo, Saslow, and Pareis (I960) 
found that two Es differing in age, pro- 
fessional background, and attitude toward 
verbal conditioning obtained the same 
verbal conditioning effects. 

Kanfer (1958) approaches this same 
problem in a slightly different manner. 
He found that in addition to status and 
physical characteristics, another source of 
variability was the ability of E to delineate 
a verbal class and to identify its class 
members. Since reinforcing operations 
usually must immediately follow the 
emitted response, quick decisions by E 
are required in classifying verbal material. 
Learning in such situations would thus be 
more variable than learning of easily dis- 
criminable responses which are not sub- 
ject to interpretation by E. Kanfer sug- 
gests that Fs role as a reinforcing agent 
in clinical situations such as therapy inter- 
views, might vary as a function of his 
perception of the client's attitudes as in- 
ferred from the client's verbal behavior. 

Krasner, Ullmann, Weiss, and Collins 
( 1961 ) extended these studies by testing 
two hypotheses: (a) that different Es can 
obtain the same verbal conditioning 
effects, and (&) that different Es can 
obtain similar correlations between S's 
conditionability and S's response to a per- 
sonality inventory. Two of the Es used 
were male Ph.D.s and the third E was a 
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female A.B. The results indicated that all 
three Es obtained an increase in the use 
of emotional words from operant to rein- 
forced trials, but this increase was signifi- 
cant only for the two male Ph.D. exam- 
iners. Correlations between S*s responsiv- 
ity to verbal conditioning and S's scores 
on personality measures were obtained 
for each of the three individual Es. The 
three Es did not differ significantly in the 
correlations they obtained, thus pointing 
up the stability on this type of measure 
of responsivity to verbal conditioning. A 
technique is thus being developed which 
can be used to investigate the effects of 
Es personality as it interacts both with S 
responsivity and with S personality meas- 
ures. Although in this particular study 
(Krasner et al., 1961) E's attributes of 
prestige, sex, or personality were not 
separated, the technique can readily be 
adapted to exploring the effects of differ- 
ences in these kinds of E personal attri- 
butes. 

An important study in this direction is 
Sapolsky's (I960) use of verbal condi- 
tioning to explore systematically the 
effects of the therapist variable in a fac- 
torial design. Sapolsky used the Schutz 
FIRO-B Scale of interpersonal "needs" to 
determine the relative "compatibility" of 
two given individuals. He hypothesized 
that the influence process in verbal con- 
ditioning would be most effective when 
S"s and E's "needs" were compatible with 
each other. In one study, he assigned stu- 
dents as Ss and as Es, on a basis of com- 
patibility of personality "needs" for one 
group, and incompatibility of "needs" for 
another. Results were that during the ac- 
quisition period the compatible group 
conditioned, whereas incompatible Ss-Es 
did not. During the extinction period (E 
out of room), compatible 5s did not ex- 
tinguish in their use of reinforced pro- 
nouns, whereas incompatible Ss increased 
their use of the pronouns to the level 
obtained by the compatible Ss. A second 
study, similarly designed, instead of com- 



patibility, used an experimental "set" of 
high personal "attraction" on the part of 
the S's. The resulting curves in this study 
were almost identical with those in the 
first study. The implications of these 
studies for the influencing process are: 
(a ) the influencing process is most effec- 
tive when the personality of the 5" and the 
E are "compatible," (&) the influencing 
process is most effective when the S ex- 
pects or has the "set" that he wiE like the 
E, (c) the influencing process, even with 
an incompatible E, is effective when he is 
physically removed, and (d) the relation- 
ship between S and E can be experimen- 
tally manipulated. 

In a design also investigating the inter- 
action of examiner-subject personality, 
Sarason 3 found a significant interaction 
between hostile fis, hostile responses, and 
hostile S's. Campbell (I960) also investi- 
gated this interaction by using nurses who 
had previously been exposed to verbal 
conditioning as examiners with patients 
as subjects in a verbal conditioning task 

Strupp (I960) expresses the viewpoint 
that the therapist personality is almost 
inextricably interwoven with his tech- 
nique and that it is extremely difficult, if 
not impossible, to determine the particu- 
lar antecedent of a given therapeutic re- 
sult. The kind of conditioning research 
being described, however, would hold con- 
stant the two variables, personality and 
technique, and enable us to determine 
antecedents of specific results. 

These verbal conditioning studies em- 
phasize earlier findings of the importance 
of the E variables, and offer techniques 
for investigating in detailed analysis these 
variables in interpersonal situations. Im- 
plicit in these types of studies is the as- 
sumption that various gross therapist 
variables, such as sex, appearance, and 
status, can be reduced to a few dimensions 
of Fs influence on S and can be investi- 

3 Sarason, I. G. Individual difference and 
situational variables in verbal conditioning. 
Unpublished manuscript, 1961. 
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gated independently or in various com- 
binations. Further, implicit is the belief 
that there is no aspect of the reinforce- 
ment "machine" which cannot be taken 
apart to see what makes it tick 

''Placebo" effects. Essential to the most 
meaningful application of reinforcement 
theory to psychotherapy is the inclusion 
of the implications of a phenomenon 
usually termed the "placebo" effect. Re- 
ports on the effects of placebos have cul- 
minated in the excellent review by 
Shapiro (I960) of the history of the 
placebo effects, and the important studies 
by Frank (1959a, 1959b), Gliedman, 
Nash, Imber, Stone, and Frank (1958), 
and Whitehorn (1958). 

Shapiro's (I960) review starts with a 
definition of the "placebo" effect as the 
"psychological, physiological, or psycho- 
physiological effect of any medication or 
procedure given with therapeutic intent, 
which is independent of or minimally re- 
lated to the pharmacological effect of the 
medication or to the specific effects of the 
procedure, and which operates through a 
psychological mechanism." He points out 
that until recently the majority of the 
cures effected by physicians were due to 
this "placebo" effect. He contends that the 
physician actually helped his patient not 
through the ritual and drug which he may 
have given, but rather by something "in- 
herent in the doctor-patient relationship." 
"The great lesson, then, of medical history 
is that the placebo has always been the 
norm of medical practice, and it was only 
occasionally and at great intervals that 
anything really serviceable, such as the 
cure of scurvy by fresh fruits, was intro- 
duced into medical practice." In discuss- 
ing the implications of this "placebo" 
effect for psychotherapy and psychiatry, 
Shapiro cites the well known fact that a 
large variety of different methods have 
been reported as being successful in bring- 
ing about therapeutic behavior changes. 
This would certainly imply some com- 



munality in behavior cutting across all 
techniques. 

Shapiro quotes Janet's views on the 
factors in the patient, physician, and situa- 
tion, which underlie therapeutic success: 
"in the patient enthusiasm, faith, belief, 
feelings in general, power of the imagina- 
tion, expectant attention, faith in authori- 
ty, the importance to the patient of being 
the object of investigation; in the physi- 
cian undoubting enthusiasm, faith, and 
belief, the unconscious personality of the 
healer; in the situation the ritual, mys- 
tery, and strangeness of the proceedings 
and the situation, changed environment, 
repetitive education, and suggestibility 
factors." These variables are similar to 
those under discussion, but under less 
specifiable terminology. Shapiro concludes 
with a suggestion which is of importance 
in attempting to determine experimentally 
the influence of the "placebo" effects in a 
research setting: "the principles underly- 
ing the effect of this variable can be ex- 
tended to non-therapeutic experimental 
situations which involve an interpersonal 
relationship with an investigator, or even 
some symbolic representative of the 
latter." 

Frank (1958, 1959a), Frank, Glied- 
man, Imber, Stone, and Nash (1959), 
Rosenthal and Frank ( 1956) , and White- 
horn (1958) stress the role of faith, ex- 
pectancy, and confidence both in achiev- 
ing effective results and as basic ingredi- 
ents for the "placebo" effect. Frank 
(1959a) says that in seeking communality 
in the therapy process the "common fea- 
ture is the patient's reliance on the thera- 
pist to relieve his distress." He terms the 
expectancy of relief to be strong enough 
to justify the term "faith." He points out 
that there are two attitudes of the thera- 
pist which foster the patient's confidence 
in him: (a) his faith in the patient's 
capacity to benefit from treatment, and 
(b) his confidence in his theory and 
method of treatment. For example, the 
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replies of psychotherapists to a question- 
naire by Wolff (1956) indicated that 
70% believe their particular form of 
therapy to be the best. Frank goes on to 
conclude that there is a good possibility 
that the emotional state of trust or "faith," 
in itself, can sometimes produce far- 
reaching and permanent changes in atti- 
tude or body states, although he points 
out that this phenomenon cannot be pre- 
dicted or controlled, and cites as evidence 
religious conversions and miracle cures. 
Finally, Frank is careful to state that he 
does not believe that all, or even most, of 
the process of psychotherapy can be ex- 
plained on the basis of trust or faith: 
"there are obviously many important de- 
terminants of the processes and outcomes 
of treatment besides the direct influence 
of the therapist based on faith and trust 
in him." Frank contends that the thera- 
pist's influence over the patient arises 
from this strong faith and favorable ex- 
pectations strengthened by cultural fac- 
tors, aspects of the referral or intake 
process, cues in the therapy situation, and 
the therapist's confidence in his ability to 
help. Cartwright and Cartwright (1958) 
take issue with Frank's emphasis on the 
role of patient's expectancies as a major 
determinant of the therapist's influence 
and his concern for the "placebo" effect. 
They feel that the terms "faith" and "be- 
lief" are too nebulous to specify objec- 
tively. 

The reinforcement approach offers the 
techniques for translating the concepts of 
faith, expectancy, and other unknown fac- 
tors involved in the "placebo" effect into 
terms which would allow for systematic 
investigation. The same may also be said 
for the kinds of therapist personality 
characteristics discussed by Strupp (I960) 
as essential in the therapeutic situation 
integrity, honesty, and dedication these 
are analyzable in terms of behaviors asso- 
ciated with effective reinforcement. 

The obvious point generally missed in 



discussing the "placebo" effect is that one 
person's behavior is serving as a source of 
reinforcement for another's behavior. In 
analyzing the behavior of the therapist, 
Krasner (1955) has called attention to 
the one common factor in all psycho- 
therapy, the presence of another person 
listening, paying attention, showing some 
interest. The therapist focuses more atten- 
tion on those aspects of the patient's ver- 
bal behavior which his particular orienta- 
tion calls for, but in any case, he displays 
a generalized form of behavior cues which 
may be called "attention." In speculating 
why these behavioral cues should serve as 
a means of reinforcing behavior. Skinner's 
(1953a) classification of attention as a 
generalized reinforcer is appropriate. The 
attention of other people is reinforcing 
because it is a necessary condition for re- 
ceiving other more specific reinforcements 
from them. Only people who are "attend- 
ing" reinforce behavior. It is reinforce- 
ment of an intermittent nature, not 
dependent on the momentary condition 
of the organism and continually being 
used to shape the behavior of others. 

Ferster (1961) develops Skinner's no- 
tion about the use of generalized rein- 
forcers in an analysis of the effects of 
positive reinforcement on autistic chil- 
dren. Ferster points out that parental re- 
sponses, such as smiling, "good," and 
"right," can have little effect on the child 
if there is not a history by which, on these 
occasions, many different forms of the 
child's performance have produced vari- 
ous reinforcers. Without the parental 
generalized reinforcement, educational 
processes and positive parental control are 
all but impossible. This control is nor- 
mally carried out by the use of praise, 
parental attention, coupled with a mild 
form of threat of discontinuing the rein- 
forcers. 

The therapist or influencer is a "rein- 
forcement machine," which by its very 
presence is supplying generalized rein- 
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forcemenr at all times in the therapy 
situation, irrespective of the particular 
technique or personality involved. In 
psychotherapy, there is a subtle manipula- 
tion of the patient's behavior by the thera- 
pist's reinforcing behavior, often without 
awareness of either person of what is 
taking place. This is the basic ingredient 
in the so-called "placebo" effect. There is 
no need to postulate a mysterious inter- 
actional effect, but rather what is taking 
place are the kinds of behavior control 
which are being cited throughout this 
paper. Thus, the "placebo" effect (gen- 
eralized reinforcement) is the common 
element in all influencing processes. There 
is reluctance by most researchers to take 
the final plunge and eliminate the last 
drop of faith, hope, and warmth, from 
psychotherapy that last element of a 
mysterious unknown, and probably un- 
knowable. But, until the therapist recog- 
nizes the full implications and potentiali- 
ties of a psychology of behavior control, 
then the aura of mysticism which still 
clings to psychotherapy will remain. 

Role-taking. Further conditions affect- 
ing reinforcement effectiveness include 
attitudinal variables such as those of the 
therapist's and patient's role conceptual- 
izations of themselves and their role ex- 
pectancies of each other (Krasner, 1959). 
Psychotherapy studies frequently cite the 
self-confidence and assurance of the thera- 
pist as having an important effect on the 
patient The elements that go into pro- 
ducing the therapist "self-assured role," 
such as personality, physical character- 
istics, prestige, training techniques, and 
socioeconomic status, are involved in the 
building of a particular "reinforcement 
machine" and determine its effectiveness 
and the kinds of behavior it will select to 
reinforce. On the patient's part, Sarbin's 
(1950) hypothesis about the variables 
associated with learning of the patient 
role are relevant. Sarbin feels that this 
would include favorable motivation, 
ability to perceive roles, and ability to 



take roles, all of which are also associated 
with learning the role of the hypnotic 
subject. "Role-taking" ability is an impor- 
tant aspect both of patient and therapist 
personality and, as such, is measurable 
and manipulatable (Krasner, 1959; Kras- 
ner, Weiss, & Ullmann, 1961). 

Prestige. The prestige or status vari- 
able readily lends itself to behavioral 
analysis by conditioning techniques. This 
can be done by the role expectancies 
created by instructional set under which E 
(or therapist) is presented to S (or pa- 
tient). One difficulty is separating role 
attributes from other E characteristics, and 
this can be done by the same E being pre- 
sented in differing roles, without E know- 
ing what role expectancies S has of him. 

As an example of this approach, Ekman 
and Friesen (I960) investigated the 
effects of status of the JB, holding per- 
sonality constant, as an influence on ver- 
bal conditioning effectiveness. They per- 
formed a series of studies in which an 
officer and enlisted man served as Es, both 
in their own role, and switching roles. 
They were unable to obtain consistent 
differences in either conditioning or ex- 
tinction attributed to either the status or 
personality of the Es, although both ob- 
tained significant conditioning. They con- 
cluded that in the particular army setting 
in which they worked, everyone giving 
"tests" to recruits had "status" even if he 
was an enlisted man. This points up the 
relevance of 5"s expectancies toward E 
and F$ role. Examiner "status" or lack of 
it is also considered in the interpretation 
of the results of other verbal conditioning 
studies (Daily, 1953; Marion, 1956; Kras- 
ner, Ullmann, Weiss, & Collins, 1961) . 

Influences on Therapist Role 

Values and ethics. Most therapists are 
uncomfortable in a role labeled as a "con- 
troller" or "manipulator" of behavior. The 
evidence, however, is that this is an ac- 
curate description of what the therapist 
role actually is. For example: Sheehan 
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(1953) and Graham (I960) both report 
studies in which key Rorschach categories 
of successful patients changed significantly 
in the direction of those of the therapist. 
Rosenthal (1955) found that "improved" 
patients changed their "moral" values in 
the direction of the therapist. Palmore, 
Lennard, and Hendin (1959) report in- 
creasing similarity in verbal behavior be- 
tween patients and therapists as therapy 
proceeds. Stekel (1951) points out that 
patients' dreams always confirm the theo- 
retical formulations of their therapist. 
Heine (1953) reports a study of three 
different approaches to therapy in which 
the patients' subjective report of the 
changes which took place within them- 
selves did not differ, while there were 
sharp differences along "school" lines as 
to the theoretical explanation of these 
changes by the patients. Whitehorn 
( 1959) points out that successful psycho- 
therapy involves leadership "toward pre- 
ferred values, toward the therapist's con- 
ception of what constitutes value in life." 
The evidence is strong that the therapist 
by virtue of his role has the power to 
influence and control the behavior and 
values of other human beings. For the 
therapist not to accept this situation and 
to be continually unaware of influencing 
effects of his behavior on his patients 
would in itself be "unethical." 

Skinner's comments (Rogers & Skinner, 
1956) on the general problem of the 
therapist as a controller are relevant to 
consideration of the ethical problems in- 
volved. Frequently, an important rein- 
forcement for the therapist himself is his 
success in manipulating human behavior. 
He may be involved in proving the value 
of a particular theory of behavior or of 
psychotherapy. There is always the possi- 
bility that the therapist control will be 
misused. The counter-control which dis- 
courages the misuse of power is repre- 
sented by the ethical standards and prac- 
tices of the organized profession of psy- 
chotherapy. Skinner feels that it is this 



danger of misuse which explains the 
popularity of theories of psychotherapy 
which deny that human behavior can be 
controlled and refuse to accept responsi- 
bility of control. However, to refuse to 
accept control is merely to leave control 
in other hands. Skinner does not agree 
with Rogers that the individual always 
holds within himself the solution to his 
problems. If the individual were the prod- 
uct of training and education which have 
effectively supplied the inner kinds of 
solutions which Rogers advocates, then it 
would be unlikely that the individual 
would be a therapy candidate. But, as is 
more likely, if the individual were the 
product of excessive or damaging kinds 
of control or extreme deprivation, it is 
unlikely that an acceptable solution was 
available within himself, but must come 
from environmental contacts. Kanfer 
( 1961 ) also comments on the motivation 
of the therapist, pointing up the long- 
range source of reinforcement as lying in 
the "professional role" and all of its attrac- 
tions for the therapist. Krasner (196 la) 
has pointed out that the investigation of 
"values" of behavior controllers such as 
psychotherapists as they are related to 
other variables such as "effectiveness" can, 
and should be, investigated by experi- 
mental techniques. 

Socioeconomic status. Only brief men- 
tion will be made of the by now accepted 
fact that there are important socioeco- 
nomic influences on the social role of the 
therapist. The New Haven studies (Hol- 
lingshead & Redlich, 1958) have pointed 
out the different social and economic class 
attitudes toward the importance of psy- 
chotherapy and the differential assign- 
ment of patients to psychotherapy accord- 
ing to social class. This further emphasizes 
the cultural conditioning of therapy role 
expectancies, both in the patient as well 
as in the therapist. Auld's (1952) study 
of the influence of social class on per- 
sonality test responses is also quite rele- 
vant to viewing psychotherapy within the 
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context of social role expectancies. This 
is a variable which is often acknowledged, 
but to which very little research has been 
directed. 

The reinforcement paradigm enables 
us to determine how the socioeconomic 
status of the therapist influences his pa- 
tient interactions. It may be surmised, for 
example, that the particular response class 
reinforced or punished will be determined 
by the therapist's class morality back- 
ground. Further, the reinforcing value of 
therapist "prestige" does not exist for all 
potential patient groups, A group such as 
delinquents may consider a therapist to be 
a "square," thus decreasing the likelihood 
of reinforcement from such a source 
being effective. 

Training and experience. A major 
variable which must enter into evaluating 
the therapist role is that of his background 
and specific training. This may be put in 
terms of investigating the information 
that has been programed into the "rein- 
forcement machine." It is this information 
which will determine the probability of 
the influence* responding to one kind of 
behavior, rather than another, and the 
contingencies related to his effectiveness. 
Training represents the conscious efforts 
of a profession to "program" future thera- 
pists. There has been recent investigation 
of the effect of training variables as they 
have influenced the psychotherapist's be- 
havior ( Ashby, Ford, Guerney, & Guerney, 
1957; Fey, 1958; Fiedler, 1950, 1951; 
Holt & Luborsky, 1958; Lakin & Lebo- 
vitz, 1958; Strupp, 1955a, 1957a). The 
particular "school" of training, the pro- 
fessional discipline, the presence or ab- 
sence of personal analysis, and the thera- 
pist's experience, have been found to be 
related to the types of verbal behavior 
and techniques used by the therapist and 
his effectiveness in changing patient be- 
havior (Strupp, 1955a, 1955b, 1955c, 
1957a, 1957b, 1958a, 1958b, I960). 

Studies on the effects of training high- 
light the kinds of information that is 



RESEARCH IN PSYCHOTHERAPY 

programed into the therapist-reinforcer. 
They also, however, point out that this 
particular "machine" is self -correcting and 
continually modifying its own behavior, 
based on the kinds of feedback or rein- 
forcement received from patients, other 
therapists, and living experiences. 

The verbal conditioning technique 
offers considerable promise for investi- 
gating the influence of training on thera- 
pist techniques. Krasner (1958b) reports 
a technique of selecting a given response 
class in a storytelling situation and 
manipulating it with selected cue rein- 
forcement by E. He reported that changes 
in a preselected class of verbal behavior 
vary as a function of the systematic appli- 
cations of behavior cues by E. Using this 
technique, Dinoff, Rickard, Salzberg, and 
Sipprelle (I960) developed an experi- 
mental design in which categories of ver- 
bal behavior comparable to different 
therapeutic approaches could be observed, 
reinforced, and measured to determine the 
effects of the reinforcement. Dinoff et si 
demonstrated that varying theoretical 
positions may direct the verbalizations of 
$s into areas in keeping with E's own 
"theoretical biases." They found that the 
frequency of responding was significantly 
increased as predicted, in the three re- 
sponse categories "Environment," "Pa- 
tient," and "Therapist." Further, the au- 
thors suggest that their technique is an 
objective, reliable, and essentially content- 
free way of manipulating and scoring 
therapeutic verbal responses. These studies 
point the way to future research in which 
therapist behavior can be deliberately 
programed and manipulated by the kinds 
of information and role-sets to which the 
therapist (E) is exposed (Krasner, 196lb). 

Winokur (1955) points out the simi- 
larity between extracting "confessions," as 
done in "brainwashing," and certain pro- 
fessional situations such as psychotherapy. 
He goes further in this direction by inter- 
preting the supervisor-student relation- 
ship in psychotherapy as an example of 
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"brainwashing." To reduce anxiety, "pris- 
oners change their thinking to conform 
with that of their 'captors.' " He feels that 
the training situation (applicable to psy- 
chiatrists, psychologists, and social work- 
ers) is a forced modification of both 
behavior and thinking to conform to that 
of the teacher-supervisor. The evidence 
he cites is anecdotal, rather than experi- 
mental, but it is quite provocative. 

Therapist Techniques 

The therapist has a broad spectrum of 
behavioral techniques available to him, 
limited only by his ingenuity in varying 
his behavior and the setting. The tradi- 
tional way of classifying therapist tech- 
niques is by the "schools of therapy" ap- 
proach. One way of investigating these 
differences would be to develop a classifi- 
cation of techniques which describe the 
characteristics of reinforcement. 

Type of reinforcement, (a) Positive: 
These are cues controlled by the therapist 
so as to reward specific responses of the 
patient. These may range from generalized 
reinforcers, such as head nodding or "mm- 
hmm," to more specific reinforcement 
such as tokens (Buss & Gerjuoy, 1958; 
Buss, Gerjuoy, & Zusman, 1958; Ferguson 
& Buss, I960), or candy (Peters & Jen- 
kins, 1954), or cigarettes (Lindsley, 1956, 
I960 ) . They may also include specific in- 
terpretive statements which expressly 
verbalize the contingencies in a patient's 
behavior. Such reinforcements may be 
difficult to classify as to whether they are 
rewarding or punishing, (b) Negative 
(punishing): These may range from 
verbal admonishments, such as "you are 
wrong" (Kanfer & Karas, 1959), through 
subtler head shaking and "huh-huh" 
(Greenspoon, 1955; Hartman, 1955; 
Mock, 1957), to actual physical pain- 
evoking stimuli, such as shock (c) Nega- 
tive (withdrawing of positive reinforce- 
ment [Ferster, 1957]): Illustrations of 
this would include techniques which vary 
"silences" (Saslow & Matarazzo, 1959), 
and techniques which use extinction 



(withdrawal of reinforcement) as a de- 
liberate controlling device (Weiss, Kras- 
ner, & Ullmann, I960). 

It should be emphasized that the same 
stimulus is not necessarily reinforcing 
under all conditions; for example, "good" 
would appear to be an excellent illustra- 
tion of a positive verbal reinforcer. How- 
ever, there is evidence (Cohen & Cohen, 
I960) that "good" is not necessarily rein- 
forcing for schizophrenics. The reinforce- 
ment history of the schizophrenic is such 
that "good" may have taken on aversive 
properties (Atkinson, 1957; Robinson, 
1957). "Mm-hmm" is probably a more 
effective reinforcer with schizophrenics 
because it does not have the social con- 
notations of "approval" that "good" has 
acquired for the schizophrenic (Krasner 
& Ullmann, 1958). On the other hand, 
Hildum and Brown (1956) found that 
with a college population, "good" was an 
effective reinforcer, whereas "mm-hmm" 
was not. Handler and Kaplan (1956) 
found that the effectiveness of a reinforcer 
such as "mm-hmm" was related to S's sub- 
jective interpretation of the stimuli as 
being either "positive" or "negative." 

If generalized reinforcers are effective 
because of the "need" for them by the 
patient, then this can be controlled by 
deprivation procedures (Gewirtz & Baer, 
1957, 1958a, 1958b; Peters & Jenkins, 
1954; Walters & Karal, I960). Various 
"brainwashing" reports (Lifton, 1956, 
1957a, 1957b) also illustrate the method 
of depriving Ss of particular needs so that 
they may be more amenable to being in- 
fluenced by techniques designed to meet 
the artificially created need. 

Medium of expression, (a) Verbal: 
This is the most frequent in therapy and 
would include the range of cues from 
"mm-hmm" through "good," "right," 
"fine," "paraphrasing" (Verplanck, 1955), 
"repetition" (Fahmy, 1953), to interpre- 
tative statements of behavior contingen- 
cies, (b) Gestural: These cues include 
head nodding (Mock, 1957), head shak- 
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ing (Hartman, 1955), smiling (Ver- 
planck, 1955), and forward movement of 
body (Ekman, 1958). (c) Mechanical: 
These may include light flashes (Ball, 
1952; Greenspoon, 1954; Nuthmann, 
1957), a buzzer (Ball, 1952; Greenspoon, 
1954), a bell tone (McNair, 1957), or 
mechanical gadgets delivering objects 
such as candy (Lindsley, 1956). In some 
instances, e.g., McNair, the mechanical 
device was labeled as signifying approval. 
(d) Symbolic: These include poker chips 
or tokens to be turned in for cigarettes or 
candy (Buss, Gerjuoy, & Ferguson, 1958). 
Various combinations of these mediums 
of expressing the reinforcement may be 
explored to determine the most effective 
combinations. 

Schedules of reinforcement. In the 
therapy situation, timing of therapist be- 
havior vis-a-vis patient verbalizations is 
of major importance. The therapist must 
make a quick decision whether a response 
of the patient belongs to the class to be 
reinforced. If so, is this the time to rein- 
force it? A failure to do so may extinguish 
the response, at least for the moment. 
Thus in an analysis of the effectiveness of 
the cueing of E, scheduling of this cueing 
is a major factor. The effectiveness of 
various intermittent reinforcement sched- 
ules has been demonstrated with labora- 
tory animals. Ferster and Skinner (1957) 
have provided a detailed description of 
such schedules. There have been success- 
ful applications of various schedules to 
reinforcing of verbal behavior ( Bachrach, 
Candland, & Gibson, 1959; Grossberg, 
1956; Kanfer, 1954, 1958; McNair, 1957; 
O'Donnell, 1959). 

Kanfer (1958) compared three types 
of reinforcement schedules in a verbal 
conditioning situation and concluded that 
reinforcing behavior of a therapist, such 
as agreement, reassurance, or approval, 
might be regulated to occur on a ratio 
schedule, if it is desirable that a client 
continue to make similar responses. On 



the other hand, he points out, if flexibility 
in topics were desired, characterized by a 
high rate of talk about a given topic only 
when the therapist supplies a cue for its 
relevance, then an interval schedule would 
be more effective in controlling the de- 
sired behavior pattern. 

O'Donnell (1959) obtained significant 
results in conditioning mildly hostile 
verbs using "good" as a reinforcement, 
with a reinforcement ratio of 66%%. 
Bachrach et al. (I960) applied "pseudo- 
fixed interval schedules" in a verbal con- 
ditioning situation. The 5s were rein- 
forced only during the last 30 seconds of 
each successive 1 -minute period. Although 
their results were somewhat equivocal, 
they concluded that social behavior may 
be examined as a function of the schedule 
of reinforcement, but that a mechanical 
reinforcer may be necessary to assure ac- 
curate programing. 

In his review of verbal conditioning 
studies, Krasner (1958a) divided the re- 
sponse class into four types of tasks de- 
manded of the S: saying words or num- 
bers, storytelling and interviews, com- 
pleting sentences, and test-like situations. 
In three of these tasks the responses may 
be considered to be discrete, whereas in 
the storytelling and interview type of 
situation (Dinoff et al. I960; Krasner, 
1958b; Mock, 1957; Pisoni & Salzinger, 
I960; Salzinger & Pisoni, 1958, I960; 
Salzinger, Pisoni, & Feldman, I960; Ver- 
planck, 1955; and others), there is a con- 
tinuous flow of conversation. E must be 
alert to make a discriminative response 
and must quickly make a number of de- 
cisions as to his own behavior. In such 
situations, the rate of reinforcement is 
rarely continuous. This is virtually im- 
possible, and not necessarily desirable. In 
a storytelling situation, Krasner ( 1958b) 
found that approximately 80% of rein- 
forceable responses were actually rein- 
forced. Tobias (I960), using the same 
type of situation, found that only 76% 
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of the animal responses which he was 
reinforcing were actually followed by 
reinforcing stimuli. What is taking place 
in situations requiring continuous verbali- 
zation, as in psychotherapy, is an inter- 
mittent reinforcement schedule, which is 
more effective, and more realistic, than a 
continuous reinforcement schedule. 

Both the amount and patterning of the 
reinforcement are also important aspects 
of the mediating contingencies. Salzinger 
(in press) reports conditioning with both 
normal and schizophrenic Ss who receive 
a large amount of reinforcement in con- 
trast to failure to condition in 5s receiving 
a small amount of reinforcement. Pattern- 
ing of reinforcement can also be used as 
a controlling technique in itself (Weiss, 
Krasner, & UUmann, I960). 

SITUATIONAL VARIABLES 

The situation variables are manipula- 
table environmental and interpersonal 
conditions under which the therapist in- 
fluences the patient. They include: the 
"atmosphere" in which therapy takes 
place; the "set" which is created for the 
patient; antecedent contacts between the 
therapist and patient; sensory input per- 
mitted the patient; and "ambiguity." All 
are controlled by the therapist, often with- 
out awareness of their effect. 

Atmosphere 

An important element of the situation 
in which the influencing process occurs 
may be labeled "atmosphere." This refers 
to the class of variables dealing with the 
S"s attitude toward the E and/or toward 
the influencing session itself. These are 
important in the "rapport" which is so 
frequently mentioned as a necessary ele- 
ment of psychotherapy. Several studies 
have attempted to manipulate experimen- 
tally the emotional atmosphere of the con- 
ditioning session. Kanfer and Karas 
(1959) provide a success and a failure 
condition on a preconditioning task. Sub- 



sequent conditioning scores were not 
significantly affected by the success and 
failure manipulations, even though 5s in 
the failure condition reported that E had 
annoyed them and had made them feel 
tense. They note that their failure condi- 
tion had the effect of increasing S"s moti- 
vation to try harder and thus s may have 
been more responsive to the E's directions 
during the conditioning session. The 
Sapolsky (I960) study previously de- 
scribed can be seen as manipulating "at- 
mospheres" by instructional set to affect 
the influencing process. 

Weiss, Krasner, and UUmann (I960) 
investigated the effects on responsivity of 
manipulating the atmosphere under which 
conditioning took place. College students 
told TAT-like stories during which E 
verbally reinforced the use of emotional 
words (Ullmann & McFarland, 1957). 
Following this, hostile and neutral emo- 
tional atmospheres were experimentally 
induced, after which the verbal condition- 
ing was repeated. The induced hostile at- 
mosphere resulted in a decrease in re- 
sponsiveness. This study indicated that by 
using a validated response class and a 
validated procedure for inducing hostility, 
atmospheres can have a demonstrable 
effect on conditioning. Thus "atmosphere" 
as an important variable in the influencing 
situation can be manipulated and experi- 
mentally investigated. 

Antecedent Contacts 

Gewirtz and Baer (1957, 1958a, 195Sb) 
report a series of studies with children, 
investigating the relationship between 
antecedent social contacts between Es and 
Ss, and subsequent effectiveness of social 
reinforcement. Walters and Karal (I960) 
and Kanfer and Karas (1959) extend 
this approach with adults. Kanfer and 
Karas (1959) found that Ss with prior 
experience with E, irrespective of the type 
of experience, were more effectively con- 
ditioned than Ss having no prior experi- 
ence with E. The authors suggest that if 
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additional contacts increase the effective- 
ness of the conditioning process, this may 
be one source of the increased control by 
the therapist as the treatment process con- 
tinues. Solley and Long (1958) also re- 
port obtaining significant verbal condi- 
tioning effects with ''mm-hrnm" only 
when E carries out "chit-chat," or infor- 
mal "rapport" getting conversation with 
5 prior to the conditioning sessions. They 
conclude that conditioning results only 
when antecedent contacts have been made. 

Walters and Kara! (I960) report a 
series of studies investigating the hy- 
potheses of Gewirtz and Baer that social 
deprivation is a motivating condition and, 
consequently, social reinforcement cues 
would be more effective following social 
deprivation than following social satia- 
tion. The results of Walters and Karal are 
somewhat equivocal, but generally do not 
provide support for the concept of a 
motivational state resulting from social 
deprivation. They suggest that social de- 
privation may be a special case of sensory 
deprivation in which 5s are deprived of 
social contact. They point out die possi- 
bility that some effects of sensory depriva- 
tion studies attributed now primarily to 
the lack of visual, auditory, and tactual 
stimulation can actually be attributed to 
the absence of social contacts, and conse- 
quent anxiety. Walters and his colleagues 
(Walters & Ray, I960; Walters & Quinn, 
I960; Walters, Marshall, & Shooter, I960) 
also report a series of other studies relat- 
ing social isolation, anxiety, and suscepti- 
bility to social influence. One conclusion 
they reach is that social isolation has, in 
itself, no effect upon susceptibility to 
social influence, but that under the 
anxiety-arousing conditions, sometimes 
produced by social isolation, Ss can be 
more readily influenced than when anxiety 
is not present. The implicit relationship 
between social deprivation studies and 
sensory deprivation studies is relevant 
also to the discussion in the next section 
on sensory deprivation. 



Sensory Input 

Sensory deprivation. The sensory input 
variable refers to the amount, variety, and 
kind of physical stimuli permitted the 
patient or "influencee." On one extreme, 
we have the conditions of DDD debili- 
ty, dependency, and dread, described by 
Farber, Harlow, and West (1957), as 
being a basic ingredient of the thought- 
reform process used by the Chinese Com- 
munists both on prisoners of war and on 
their own people, Farber et al. point out 
that the conditions of DDD lead to in- 
creasing susceptibility to conditioning. 
The Chinese used the DDD on an inter- 
mittent reinforcement schedule to condi- 
tion prisoner expectancies. Lifton ( 1956, 
I957a, 1957b) also describes what he 
terms "milieu control" in the Chinese 
thought-reform process. This is the con- 
trol and manipulation of all communica- 
tion and sensory stimulation directed to 
the "reformee." Lifton compares the 
effects of the "milieu control" on a 
prisoner to the effects on the sensory de- 
prived Ss of Lilly (1956). In both proc- 
esses the S is unable to check on what is 
reality. Having no other source of verifi- 
cation or information, the S has no alter- 
native but to accept the communications 
which come to him. In one instance, this 
is the propaganda of the Chinese Com- 
munists; in the other, it is the internal 
push which manufactures the hallucina- 
tions which fill out his environment. The 
works of Hebb (1958), Heron, Doane, 
and Scott (1956), Azima and Cramer- 
Azima ( 1956b, 1957) and the symposium 
edited by Solomon ( 1961) further ampli- 
fy these points. Hebb (1958) analyzes 
the effects of perceptual deprivation on 
human motivation. Since the adult is de- 
pendent on his sensory environment, the 
first approach to him in "brainwashing" is 
by isolation (others being sleep, fatigue, 
and hunger). The effects of isolation are 
hallucinations, disturbances of self per- 
ception, impaired intelligence test score, 
changes in EEG records, and visual dis- 
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turbances. Such effects Hebb found to be 
reversible, disappearing in a few days 
after the isolation ends. However, after 
telling Ss "ridiculous" things during their 
state of isolation, he found that such 
"propaganda effects" were longer lasting. 
Thus, it would appear that an individual 
is more responsive to influence from his 
environment while under sensory depriva- 
tion, and less likely to extinguish behavior 
learned while under such conditions. 

Studies by Adams, Carrera, Cooper, 
Gibby, and Tobey ( I960) and Azima and 
Cramer-Azima (1956a) also use sensory 
deprivation procedures as such, to enhance 
therapeutic change in patients. Azima and 
Cramer-Azima (1956a) used sensory iso- 
lation as a therapeutic technique in modi- 
fying behavior of psychotic patients with 
problems of depersonalization. They put 
a variety of patients in a situation of 
partial sensory and expressive isolation 
for an average period of four days. Some 
of the patients appeared to have been 
helped by this process, others possibly 
worsened. 

The kinds of physical stimuli condi- 
tions which the therapist controls may 
include: couch or easy chairs (face to 
face); room illumination; sound proof- 
ing; mood musk; heavy carpets; bland 
clothing. These types of stimuli can be 
manipulated to make behavior control 
more effective. It would seem reasonable 
that cutting down external stimuli would 
enable the patient to focus on and pay 
more attention to therapist originated 
stimuli, making them more effective. 

Sensory enhancement. On the opposite 
side of the sensory input continuum, there 
are several studies which approach psy- 
chotherapy by sensory enhancement. Mc- 
Reynolds, Acker, and Daily (1959) rea- 
son that if certain symptoms of schizo- 
phrenia, such as hallucinations, feelings of 
depersonalization, and difficulties in con- 
centration, are the result of functional 
sensory deprivation, then it would be ex- 
pected that "perceptual enhancement" in 



schizophrenics would bring about allevia- 
tion of the symptoms indicated. In pre- 
liminary work on six patients, each par- 
ticipating in a number of activities de- 
signed to enhance rate of perceptual input 
and assimilation, the evidence points in 
the direction of their hypothesis. In a 
verbal conditioning study, Chan (1958) 
found that the effect of enhancing visual 
sensory input in the form of geometric 
forms, colors, algebraic signs, and Chinese 
characters increased the probability of 
susceptibility to verbal conditioning. 

Subliminal stimulation. Under the 
heading of sensory input variable should 
also be included the studies on subliminal 
stimulation. These studies are relevant for 
the study of behavior control in at least 
three ways: they are essentially techniques 
of behavior control; they are related to 
learning without awareness; and they raise 
ethical problems. The excellent reviews 
by McConnell, Cutler, and McNeil (1958) 
and Goldiamond (1958) bring the field 
together in such a way that subliminal 
stimulation can be incorporated into the 
more general field of behavioral control. 

Set and Ambiguity 

A person in an influencing situation is 
continually seeking cues as to what is ex- 
pected of him. It does not follow, how- 
ever, that these cues should be clear cut 
for maximum effectiveness, as evidenced 
by studies of the importance of ambiguity 
in the influencing process. Frank (1959) 
points out that "it is in the ambiguity of 
the therapeutic situation, however, that its 
greatest potentiality for influence proba- 
bly lies. Like the interrogators in thought 
reform, some psychotherapists convey to 
the patient that they know what is wrong 
with him, but that he must find it out for 
himself in order to be helped. This is one 
means of enlisting his participation, but 
it also gives the patient an ambiguous 
task." Bordin (1955) also sees ambiguity 
as part of the stimulus value of the thera- 
pist. Dibner (1958) found evidence to 
confirm the deduction that anxiety is posi- 



76 



RESEARCH IN PSYCHOTHERAPY 



tively related to ambiguity in an inter- 
personal relationship. 

Ambiguity is closely related to the 
variable of "set" which can be expressed 
in terms of S's expectancies of what is to 
occur during a particular influencing 
session. Asch (1948) reports that in his 
studies S changes his set from "what dif- 
ferences can I observe between these ma- 
terials" to "which of these am I expected 
to like and dislike." Hall (1958) found 
significant verbal conditioning only in Ss 
who had become "ego-involved" by the 
instructional set. In a study by Krasner, 
Weiss, and Ullmann (1961) the very 
questioning about awareness influenced 
S's performance. One effect of the re- 
ported awareness interview itself was to 
change S's definition of the experimental 
task; that is, E signaled S that the latter's 
knowledge of what is going on was a part 
of the experimental situation. Thus, con- 
ditioning trials occurring after an aware- 
ness interview can be viewed as problem 
solving trials. This served to decrease the 
ambiguity for S, and in this study (Kras- 
ner et al., 1961 ) the result was a decrease 
in responsivity. In his investigation of the 
psychology of affiliation, Schacter ( 1959) 
concludes that ambiguous situations lead 
to a desire to be with others as a socially 
evaluating event which helps determine 
the appropriate and proper reaction. 
These findings are consistent in interpret- 
ing ambiguity as enhancing the reinforc- 
ing value of the therapist. The studies of 
Ekman, Krasner, and Ullmann 4 and 
Sarason and Ganzer 5 investigated the 
relationship between instructional set, 
operant level, and responsivity to rein- 
forcement. In both studies, responsivity 
was manipulated by the instructional set. 

* Ekman, P., Krasner, L., & Ullmann, L. P. 
The interaction of set and awareness as deter- 
minants of response to verbal conditioning. 
Unpublished manuscript, 1961. 

5 Sarason, I. G., & Ganger, V. J. Anxiety, 
reinforcement, and experimental instructions. 
Unpublished manuscript, 1961. 



Group Setting 

One final note about the situation vari- 
able: the influencing process need not be 
limited to a one-to-one relationship (Asch, 
1948; Bachrach, I960; Cieutat, 1959; 
Dinoff, Horner, Kurpiewski, & Timmons, 
I960; Sidowski, 1959). Asch (1948, 
1956) and those using his influencing 
techniques have investigated the process 
under simulated group conditions. Bach- 
rach et al. (I960) defined a group setting 
as using two Es working as a team of 
"human programers" reinforcing the third 
person in the group, the naive S. Dinoff 
et al. (1960) investigated the effective- 
ness of verbal conditioning in a group 
therapy situation with a schizophrenic 
population. 

THERAPIST-PATIENT INTERACTION 
VARIABLES 

The "therapist variables" cannot be in- 
vestigated except insofar as they interact 
with patient characteristics. For maximal 
effectiveness of the reinforcement process 
the following manipulable patient char- 
acteristics should be considered in the 
context of therapist and situational vari- 
ables: type of population; personal char- 
acteristics such as age, sex, intelligence, 
education, personality; and socioeconomic 
class. 

Type of Populations 

One of the trends in verbal condition- 
ing studies has been the extension of 
these techniques to adult populations 
other than college students and schizo- 
phrenics. This has included extension 
along diagnostic lines: delinquents (Cairns, 
I960); mental defectives (Barnett, Pryer, 
& Ellis, 1959); "neurotics'* (Leventhal, 
1959; and Johns & Quay 6 ); and along 
education lines: medical students (Kras- 



6 Johns, J. H., & Quay, H. C The effect of 
social reward on verbal conditioning in psy- 
chopathic and neurotic military offenders. Un- 
published manuscript, 1959. 
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ner, Ullmann, Weiss, & Collins, 1961); 
high school educated military trainees 
(Ekman& Friesen, 1960a, 1960b; Friesen 
& Ekman, I960). Johns and Quay 6 report 
failure in conditioning a psychopathic 
group which was interpreted as evidence 
of psychopathic resistance to social re- 
ward. Systematic attempts at comparing 
diagnostic group responsivity are neces- 
sary as preliminary to predicting reaction 
to psychotherapy, and some studies have 
moved in this direction (Campbell, I960; 
Franks, 1956; Hagen, 1959; Hartman, 
1955; Johns & Quay 6 ; Leventhal, 1959; 
O'Connor & Rawnsley, 1959; Salzinger, 
in press). 

Although verbal conditioning tech- 
niques have been effective with this wide 
variety of people, there are questions as 
to the susceptibility of schizophrenics to 
conditioning procedures (Cohen & Cohen, 
I960). However, both Dinoff et al. 
(I960) and Salzinger and Pisoni (1958) 
found that they could condition schizo- 
phrenics, but the effect is short-lived and 
extinction is rapid. Dinoff et al. suggest 
the use of partial reinforcement during 
conditioning to extend the period of ex- 
tinction in schizophrenics. The authors 
suggest that negative findings with schizo- 
phrenics (Cohen & Cohen, I960) may 
have resulted because the effect was hid- 
den due to its brevity. Others reporting 
successful conditioning of schizophrenic 
patients include: Krasner (1958b); 
Krasner and Ullmann (1958); Mock 
(1957); Weiss, Krasner, and Ullmann 
(1961). Specification of type of schizo- 
phrenia and severity of illness are essen- 
tial in these studies as in all research with 
schizophrenics. 

Patient Characteristics 

Personality. The relationship between S 
personality and S susceptibility to condi- 
tioning techniques has been investigated 
under a variety of conditioning proce- 
dures (Anderson, 1959; Babladelis, I960; 



Buss & Gerjuoy, 1958; Cairns, I960; 
Campbell, I960; Cushing, 1957; Daily, 
1953; Ekman, 1958; Franks, 1956, 1957; 
Kirman, 1958; Gelfand & Winder, 1961; 
Matarazzo et aL, I960; McKee, I960; 
Medini, 1958; O'Donneil, I960; Sarason, 
1958; Sarason & Campbell, in press; 
Taffel, 1955). Some studies hypothesize 
differentiations in responsivity along per- 
sonality dimensions, such as anxiety, 
whereas others are nosologically oriented. 
Since the focus of this paper is on the 
therapist variable as such, we will not go 
further into the patient personality vari- 
ables, other than to point to two types of 
studies which can be used to investigate 
the effects of the patient variable on the 
reinforcement process. First, there is 
manipulation by instruction of the thera- 
pist personality-patient personality inter- 
action (Sapolsky, I960). The second is 
a manipulation of the patient personality 
variable by inducing an experimental 
atmosphere (Weiss, Krasner, & Ullmann, 
I960). 

In a broader view of a psychology of 
behavior influence there are other impor- 
tant approaches to investigating the rela- 
tionship between personality character- 
istics and susceptibility to the influencing 
process (Asch, 1948, 1956; Berkowitz & 
Lundy, 1957; Helson, Blake, Mouton, & 
Olmstead, 1956; Kelman, 1956; Janis, 
1954) . All are relevant to a psychology of 
behavior control and consequently to the 
psychotherapy process. 

Socioeconomic status. The factors dis- 
cussed above affecting the behavior of the 
therapist as a function of his class identi- 
fication also hold for the patient, and 
interaction effects become crucial. Al- 
though much lip service is given to the 
importance of this variable, few research 
data are available. Imber, Frank, Gliedman, 
Nash, and Stone (1956) and Imber, Nash, 
and Stone (1959) investigated the rela- 
tionship between suggestibility, social 
class, the acceptance, and duration of 
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psychotherapy. Imber et al. (1956) found 
that suggestible patients, as measured by 
the Sway Test, tend to remain in psycho- 
therapy. It was postulated that suggestible 
patients were influenced by the authority 
of the doctor in his role as expert advisor 
and the general prestige of the medical 
setting. No differences in suggestibility 
were found between middle- and lower- 
class patients, but middle-class patients 
who were "suggestible" were most respon- 
sive to psychotherapy in terms of rate of 
"staying in." 

Response class. The specific point of 
interaction in the therapist-patient rela- 
tionship is between the patient response 
class and the therapist reinforcing cue 
behavior. That such interaction is lawful 
and predictable in the therapy situation 
has been demonstrated in studies such as 
Murray (1954), Bandura, Lipsher, and 
Miller (I960), and others. The response 
class is usually the most important aspect 
of patient behavior which the therapist 
influences. Response classes that are influ- 
enceable are limited only by ITs ingenuity 
in labeling them. In the verbal condition- 
ing studies alone a whole variety of re- 
sponse classes directly relevant to psycho- 
therapy have been shown to be influence- 
able under certain specified reinforcement 
conditions. These are: affect statements 
(Anderson, 1959; Buss & Durkee, 1958; 
Gushing, 1957; Doering, 1959; Krasner, 
Ullmann, Weiss, & Collins, 1961; Pisoni 
& Salzinger, I960; Salzinger & Pisoni, 
1958, I960; Salzinger, Pisoni, & Feldman, 
I960; Weiss, Ullmann, & Krasner, I960) ; 
self -reference statements (Adams & Hoff- 
man, I960; Babladelis, I960; Rogers, 
1960); "hallucinations" (Dobie, 1959); 
"negative words" (Zedek, 1959); "neu- 
rotic" verbalizations (Everstine & Ben- 
dig, I960); "early childhood memories" 
(Quay, 1959); references to "mother" 
(Krasner, 1958b; Mock, 1957); opinions 
and attitudes (Verplanck, 1955; Ekman, 
1958); "complex" sentences (Barik & 
Lambert, I960); "acceptance of self" 



(Nuthmann, 1957); and "confiding re- 
sponses" (Cairns, I960). 

Berg (1958) and Bachrach (in press) 
report work currently in progress by 
Greenspoon that is even more directly 
related to psychotherapy. This is being 
done within the context of a therapy in- 
terview with patients. When the patient 
verbalizes bizarre material, the therapist 
swivels his chair around, turning his back 
on the patient, opens his mail, or makes 
a telephone call. When the patient talks 
realistically, the therapist reinforces this 
rational content by leaning forward and 
nodding or saying "mm-hmm." Irrational 
material begins to drop out and material 
such as realistic discussion of illness in- 
creases. Greenspoon also reports observa- 
tions, systematically gathered during regu- 
lar counseling sessions of the therapist 
reinforcing patient verbalizations about a 
response class such as sex by looking in- 
terested and leaning forward. The num- 
ber of sex references then markedly in- 
crease during the course of the interview. 
Rickard, Dignam, and Horner (I960) 
report the manipulation of verbal be- 
havior in an actual therapeutic treatment 
case. Rational verbalizations in a 60-year 
old delusional patient were positively re- 
inforced, while delusional material was 
"punished" by the therapist "looking 
away." A high level of rational speech 
was obtained, but extinction also was 
rapid. 

Krasner and Ullmann (1958) demon- 
strated that E could switch from rein- 
forcing one response class to another with 
a significant increment of the second 
class. In this study, using storytelling pro- 
cedures, the response class reinforced was 
switched from "mother" to "father" refer- 
ences with the same patients, and the new 
reinforced response class increased signifi- 
cantly as a function of Fs behavior. 

Studies have also appeared in other 
areas which have demonstrated the effects 
of the influencing process on verbal re- 
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sponse classes, especially those which may 
be termed as indicating "attitudes" or 
"opinions" (Asclx 1948; Back, 1951; 
Bergin, I960, Kelson, Blake, Mouton, & 
Olmstead, 1956; Holland, Janis, & Kelley, 
1953; Janis & King, 1954; Kelman, 1950, 
1956, 1958; Schacter, 1959; Scott, 1957; 
Staats, 1959; Staats & Staats, 1958; Staats, 
Staats, & Heard, 1959). All of these ap- 
proaches have in common the use of in- 
fluencing techniques to change verbal be- 
havior. Blake and Mouton (1957), based 
on their studies of the dynamics of influ- 
ence and coercion, conclude that the most 
significant dimensions operating in the 
exertion of influence under face-to-face 
conditions are: (a) the properties of the 
direct influence induction, and () the 
properties of the social background. Their 
major emphasis is on training in various 
phases of social science so that the thera- 
pist may become aware of the forces 
within the social situation which must be 
shifted in order to effect behavior changes. 

Awareness. The variable of awareness 
is crucial to the influencing process. The 
problem of whether learning without 
awareness does, or does not, occur has 
been repeatedly explored under many 
different guises in laboratories and experi- 
mental settings (Adams, 1957; Dulany, 
1961; Eriksen, 1961; Kanfer & Mc- 
Brearty, 1961; Levin, I960; Sidowski, 
1954; Tatz, 1956). In psychotherapy the 
question is whether you can have be- 
havioral changes in a patient without his 
verbalizing insight into the relationship 
between his present behavior and (a) a 
set of events which have occurred in his 
past life, and/or (b) the therapist's be- 
havior. As is true of other aspects of 
psychotherapy, the process of awareness 
has been difficult to measure. Verbal con- 
ditioning studies are faced with the diffi- 
culty of an extremely unreliable measure 
of awareness, namely that of the S*s self 
report. The issue is the same as that found 
in psychotherapy self reports are unre- 
liable and also subject to the influencing 



process Krasner, Weiss, and Ullmann 
(1961) investigated relationships be- 
tween awareness and behavior change in 
a verbal conditioning situation with col- 
lege students using ''mm-hmm" to rein- 
force "emotional words.*' The authors' 
position was that awareness is not a sinde 
phenomenon but refers to a complex of 
different cognitive events. Therefore, 
awareness was first investigated as a de- 
pendent variable by the technique of re- 
ported awareness typical in other verbal 
conditioning studies. Reported awareness 
at this point of the study was not signifi- 
cantly related to (a) increased respon- 
sivity on reinforced trials as compared to 
operant trials, (b) previously induced 
emotional atmospheres, either hostile or 
neutral (Weiss et al, I960), or (c) pre- 
vious pattern of reinforced trials. Thus, a 
typical measure of ^s awareness, his self 
report, was not associated with either re- 
sponsivity to verbal conditioning or with 
two experimental manipulations (atmos- 
pheres and patterns of reinforcement) 
which in themselves had significantly de- 
creased responsiveness to verbal condi- 
tioning. Awareness was then treated as an 
independent variable and was manipu- 
lated by means of two different sets of 
instructions. Half the Ss were given cues 
designed to focus attention on the phe- 
nomenon of verbal conditioning. It was 
found that induced-awareness cues de- 
creased responsiveness on subsequent rein- 
forcement trials. The second experimental 
manipulation of awareness followed one 
of two sets of instruction: Ss were ex- 
plicitly informed of the reinforcing con- 
tingency and were told that either (a) 
they had been controlling E, or (b) E 
had been controlling them. Two reinforce- 
ment trials followed these instructions. 
These resulted in significant heterogeneity 
of variance. Whether S would respond by 
increasing or decreasing his "emotional 
words" was predictable based on the pre- 
vious experimental conditions to which 
he had been exposed. 
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The following conclusions were drawn: 
(a) Conflicting reports on the relation- 
ship between reported awareness and con- 
ditioning reflect conceptual confusion 
with regard to the role of reported aware- 
ness in performance, (b) Ss' awareness 
of the reinforcing contingency will affect 
performance in verbal conditioning ex- 
periments when awareness is made an 
integral part of Ss' task (c) The specific 
effect that awareness will have on per- 
formance depends on subject-determined 
variables, e.g., Ss emotional attitude to- 
ward E. 

In another study in which "awareness" 
was experimentally manipulated (Ekman, 
Krasner, & Uilmann, see Footnote 4) the 
storytelling task was introduced to half 
the Ss as a measure of empathy (amount 
of warmth and feeling towards other 
people) and was introduced to the other 
half as a measure of personal problems 
(difficulties in getting along with other 
people). Half the Ss in each group were 
told that "after the first few stories I [E] 
will let you know that you are revealing 
your own personal problems (or that you 
are showing warmth) by going 'mm-hmm* 
whenever you do this." In this factorial 
design, there were no differences among 
the four groups in number of emotional 
words used during operant trials. How- 
ever, the groups differed significantly in 
increase of number of emotional words 
used during reinforced trials. The groups 
for whom the task had been structured as 
a measure of empathy showed significant- 
ly greater increase of emotional words 
during reinforced trials than the group 
for whom the task had been structured as 
revealing personal problems. The greatest 
increase was in the "empathy" group who 
had been given "awareness" instructions. 
In short, both the structure given the 
examiner's reinforcing behavior and the 
subject's awareness of said behavior were 
germane to the direction of his verbal 
behavior. The "personal problem" group 
who had been given "awareness" instruc- 



tions decreased slightly under reinforce- 
ment. Thus, verbal conditioning allows 
for the manipulation of "awareness" itself 
in such a way as to permit the measure- 
ment of its influence on S's subsequent 
behavior. Taken by itself, in terms of 
verbal report, "awareness" is a concept of 
dubious validity in verbal conditioning 
studies. 

GENERALIZATION AND PREDICTION 

Two major problems facing the thera- 
pist, as well as E in other influence situa- 
tions, are those of generalization and pre- 
diction: (a) What is the relationship be- 
tween S"s verbalizations in the influencing 
situation and S's behavior outside of that 
situation? (b) What are the techniques 
of predicting those who will be most 
susceptible to the influencing process? 

Prediction 

Implicit, of course, in all verbal condi- 
tioning studies is the element of deter- 
mining the most effective influencing 
conditions for predictive purposes. This 
is especially so for studies hypothesizing 
relationships between S personality vari- 
ables and conditionability, previously dis- 
cussed. I. G. Sarason (1958) carries this 
closer to psychotherapy by investigating 
responsivity to verbal conditioning as it 
is related to rated behavior in the psycho- 
therapy situation itself. One finding, for 
example, was that patients compliant in 
psychotherapy were significantly more 
conditionable than noncompliant patients. 
A major assumption still to be demon- 
strated is that the S who is susceptible to 
influence in one situation, such as hyp- 
nosis or brainwashing, would also be sus- 
ceptible to influence in other situations, 
such as verbal conditioning or Asch type 
procedures. 

Weiss, Uilmann, and Krasner (I960) 
found in a group of college students a 
positive relationship between responsivity 
to verbal operant conditioning and an in- 
direct measure of susceptibility to hyp- 
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nosis a scale of likelihood of hypnotiza- 
bility adopted from hypnosis research of 
Hilgard and Weitzenhoffer. In a later 
study by Krasner, Ullmann, Weiss, and 
Collins (1961), this scale was expanded 
into a more general "Resistance to Con- 
ditioning Scale" which includes items 
from the CPI and MMPI. This scale cor- 
related significantly with responsivity to 
verbal conditioning (of emotional words) 
in a group of medical students. Further 
refinements on this prediction scale are 
now in progress (Ullmann, Weiss, & 
Krasner, 1961). 

Along similar lines, Crowne and Strick- 
land (1961) found positive and signifi- 
cant relationships between responsivity to 
verbal conditioning and scores on a social 
desirability scale. This scale correlated 
significantly with a tendency to conform 
as measured by the Barron Scale and per- 
formance in a standard Asch conformity 
situation. Crowne and Strickland found 
that those Ss (college students) scoring 
high on this social desirability or need for 
approval scale were conditionable in the 
verbal conditioning situation, whereas 
those scoring low on this scale were not. 

Generalization 

No other issue is of more concern to 
the therapist than that of the generaliza- 
tion of behavior change from office to 
"life outside." Verbal conditioning studies 
have offered a clear-cut approach to this 
problem (B. R. Sarason, 1957), although 
generalization effects have been difficult 
to demonstrate (Dinoff, Horner, Kur- 
piewski, Rickard, & Timmons, I960; Ek- 
man & Friesen, 1960a; Moos, 1961; 
Rogers, I960; Sandier, Gersten, & Green- 
spoon 7 ; Tobias, I960; Weide, I960; 
Williams, 1958). 

Ullmann, Krasner, and Collins ( 1961 ) 
approached the problem of generalization 

7 Sandier, J. S., Gersten, C O., & Green- 
spoon, J. The effects of behavioral cues on test 
performance in a clinical setting. Unpublished 
manuscript, I960. 



by first isolating the behaviors of the 
therapist and patient which are character- 
istic of the psychotherapy situation. Then 
they systematically manipulated these be- 
haviors to test hypotheses about the psy- 
chotherapeutic process. These hypotheses 
were: (a) a person can influence the 
behavior of another in a predictable direc- 
tion, (b) this behavior change has a 
desirable effect on behavior in a second 
criterion situation, and (c) the changed 
behavior in the criterion situation is asso- 
ciated with a specific aspect of the already 
circumscribed behavior of the therapist. 

Neuropsychiatric patients who were re- 
ceiving group therapy participated in 
storytelling sessions during which emo- 
tional words were reinforced in one of 
three ways: a positive-personal manner 
("mm-hmm" and head nodding); an im- 
personal-unstructured manner (the click 
of an electric counter); and no reinforce- 
ment at all. Ratings (Finney, 1954) made 
by the group therapist before and after 
the experimental storytelling sessions in- 
dicated a significant gain in adequacy of 
interpersonal relationships manifested in 
group therapy for the group receiving 
positive-personal reinforcement (2=1.83). 
There was no significant gain for the 
other two groups on this criterion meas- 
ure (/=0.34 and =0.15). The results 
supported the hypothesis that one person 
can influence another in a positive way 
and that this change is measurable by an 
independent criterion situation. Further, 
this change in an S"s behavior was demon- 
strated to be associated with specific be- 
havior on the part of the experimenter. 
The authors point out that the hypothesis 
of the positive correlation between change 
in use of verbal class during experimental 
sessions and change in the criterion may 
be oversimplified. Using a different E, 
new Ss, and introducing nonreinforced 
operant trials, Ullmann, Krasner, and Ek- 
man (1961) found that patients in a 
positive-personal reinforcement group in- 
creased significantly in group therapy 
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scores (=2.25), while the change of a 
"no-contact" comparison group approached 
but did not reach significance (=1.69). 
More importantly, when only Ss were 
used whose admission had occurred at 
least three months prior to the start of 
the experiment, it was found that the 
positive-personal reinforcement group 
gained an average of 9.00 points on 
Finney's Group Therapy Scale, while no- 
contact comparison subjects gained only 
1.15 points on the average. The difference 
between the means of the two groups was 
statistically significant (=1.95). In this 
study, the relationship between increased 
group therapy scores and increased use of 
emotional words during the first two rein- 
forced trials was insignificant. Thus, it is 
unlikely that the improvement in rated 
behavior was due to an increase in the 
use of emotional words, per se. Rather, 
we would hypothesize that the major ele- 
ment underlying these results was a form 
of role retraining in terms of learning the 
appropriateness of spontaneous expression 
in an interpersonal situation. 

It should be pointed out that Rogers 
(I960) and Williams (1958) both failed 
to obtain generalization effects after hav- 
ing obtained significant effects of condi- 
tioning. It is speculated that the difference 
in results lies in the different relationship 
between the response class conditioned 
and the criterion behavior. 

A significant generalization effect (fa- 
vorable effect on a clinical criterion asso- 
ciated with verbal conditioning) was also 
obtained in another study with psychiatric 
patients (Ullmann, Weiss, & Krasner, 
1961). A perceptual defense task consist- 
ing of matched threatening and neutral 
words on successive carbons was admin- 
istered to one group prior to verbal con* 
ditioning of emotional words and to 
another group after verbal conditioning 
of emotional words. The latter group had 
lower defensive scores than the former. 
Further analysis of the data indicated that 
the "inhibitors" (repressers) as measured 
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by the MMPI (Ulimann, 1962) ^ showed 
significant generalization, while "facilita- 
tors" (externalizers) showed no signifi- 
cant effect of prior verbal conditioning of 
emotional words. 

PSYCHOTHERAPY RESEARCH 
PRESENT AND FUTURE 

In his review chapter on "psychothera- 
py," Rotter (I960) summarizes several 
current research trends which have been 
emphasized in this paper: a greater flexi- 
bility in techniques; greater appreciation 
of patient-therapist interaction; greater 
willingness to challenge old taboos and 
beliefs in regard to psychotherapy, such 
as the importance of personal analysis and 
the "passive, constrained, and non judg- 
mental role of the therapist"; more con- 
cern with psychotherapeutic procedure 
and less with outcome; concentration on 
the therapist and his verbal and nonverbal 
responses; and the increasing importance 
of "values" in psychotherapy. Further, 
Rotter suggests that more attention be 
paid to conceiving of psychotherapy as "a 
social interaction which follows the same 
laws and principles as other social inter- 
actions, and in which many different 
effects can be obtained by a variety of 
different conditions/' He also feels that 
there is a relative lack of appreciation of 
the potential for using laboratory ana- 
logues in which the principles underlying 
psychotherapy can be investigated under 
relatively controlled conditions. 

In fully assessing the implications of 
verbal conditioning studies for investigat- 
ing psychotherapy, it should be pointed 
out that a certain percentage of these 
studies report negative results. In his re- 
view of 31 verbal conditioning studies, 
Krasner (1958a) found that approxi- 
mately 25% of these studies report some 
aspects of negative results the "rein- 
forced" behavior either did not increase 
significantly or its increase was no more 
than in a control group. A recent study of 
Sullivan and Calvin (1959) also reports 
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failure to condition "opinions" in a stu- 
dent group. These studies point to the 
need for investigation of the conditions 
under which the influencing process is 
not effective. Azrin, Holz, Ulrich, and 
Goldiamond (1961) report difficulties in 
replicating Verplanck's (1955) earlier 
work, and discuss some of the problems 
involved in adequate measurement of 
verbal operants and in training examiners. 
Barik and Fillenbaum ( 1961 ) also discuss 
"failures" to condition as they are related 
to the use of control groups. 

A brief summary of the current trends 
in verbal operant conditioning studies 
would point up the directions that this 
approach to research on interpersonal 
processes has been headed, as well as offer 
a guide for future research: (a) an in- 
creasing complexity of design which 
places greater emphasis on the interaction 
of variables; ( b ) wider range of types of 
people being reinforced; (c) wider range 
of response class being reinforced with 
more emphasis on using continuous ver- 
bal behavior, rather than discrete verbal 
behavior; (d) explicit use of verbal con- 
ditioning as a therapeutic technique; (e) 
the study of issues which have evolved 
out of other learning studies, such as 
scheduling of reinforcement, learning 
without awareness, and instructional set; 
(/) the employment of operant condi- 
tioning techniques to lead to mechanical 
instrumentation for more effective be- 
havior change; (g) the use of verbal con- 
ditioning techniques as stable measures of 
responsivity as the dependent variable m 
evaluating personality changes; (h) ex- 
tension of verbal conditioning techniques 
to group situations; (*) the construction 
of predictive personality scales of respon- 
sivity to verbal conditioning and other 
influencing situations; (;) verbal condi- 
tioning responsivity as a predictor of suc- 
cess in psychotherapy; (I) verbal condi- 
tioning procedures as an experimental 
"control" on other treatment techniques. 
Finally, it should be emphasized that this 
technique of investigation offers oppor- 



tunities to bring the process of psycho- 
therapy within the framework of a scien- 
tific learning theory. Further, these tech- 
niques of investigation can fit in with a 
broader psychology of behavior control by 
incorporating into their design such tech- 
niques as hypnosis, sensory deprivation, 
isolation, drugs, physiological measure- 
ments, and nonverbal behavior. Future re- 
search can also use these techniques to 
investigate the counter-controls exerted 
by the patient on the therapist. The ideal 
"reinforcement machine" will have these 
effects programed in, just as the experi- 
enced therapist is able to recognize and 
use patient "controlling" behavior. 

One of the criticisms leveled against 
extrapolating the results of "laboratory" 
studies, such as verbal conditioning, into 
the "living process" of psychotherapy is 
that these studies miss many of the suble- 
ties and complexities involved in the 
psychotherapy process and tend to over- 
simplify the process. Rather than being 
defensive in interpreting laboratory 
studies of the influencing process, there is 
now enough evidence that these tech- 
niques can be used not only for research, 
but as actual therapeutic techniques. The 
studies by Ullmann, Krasner, and Collins 
(1961) and by Rickard et al. (I960) 
were used in psychotherapeutic context to 
change patient behavior in a desired direc- 
tion. Other studies (Salzinger & Pisoni, 
1958, I960) take place within the context 
of ordinary clinical interactions, or were 
labeled as "psychotherapy" (Williams, 
1958). Greenspoon 8 is in the process of 
developing a modified tape recorder which 
can be utilized as a mechanical reinforcer 
in a psychotherapy situation. 

As part of an ongoing study by Ull- 
mann, Krasner, and Gelfand, 9 each in- 
stance of the reinforced verbal class, erno- 

8 Greenspoon, J. Personal communication, 
1960. 

9 Ullmann, L. P., Krasner, L., & Gelfand, 
Donna M. Fantasy hostility associated with the 
attenuation of aggression. Research in progress, 
1961. 
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tional words, was scored on a scale of 
"Pleasantness-Unpleasantness." To elimi- 
nate individual differences in number of 
emotional words used, the average rating 
of emotional words determined each S's 
score. The correlations between pairs of 
raters for 25 cases were .96, .93, and .93. 
Comparing these scores for emotional 
words used during operant and reinforced 
trials for 80 college Ss (Weiss, Krasner, & 
Ullmann, I960), the emotional words 
used during reinforcement were signifi- 
cantly pleasanter than the emotional 
words used during operant trials, the 
critical ratio being 5.27. Similarly, for 
another group of 48 college students 
(Ekman, Krasner, & Ullmann, see Foot- 
note 4) emotional words used during 
reinforced trials were significantly pleas- 
anter than the emotional words used dur- 
ing operant trials, the critical ratio being 
4.84. Aside from the similarity of this 
score to the Discomfort-Relief Quotient 
(DRQ) (Mowrer, 1953a), work in prog- 
ress indicates that "Pleasantness-Unpleas- 
antness" scores are associated with tension 
measures such as Barren Ego-strength 
(1953) and McReynolds Incongruency 
Technique (1958). 

Krasner and Winder have used role- 
taking techniques for training schizo- 
phrenic patients to take the E role in a 
verbal conditioning situation with college 
students as Ss. Preliminary work indicates 
that this type of training is feasible, and 
the plan is to gradually extend the kind 
and complexities of verbal behavior which 
the schizophrenic patient is trained to 
reinforce, as well as to increase the com- 
plexities of the cues which the schizo- 
phrenic patient will use as reinforcers. 

The motor operant conditioning studies 
(Bullock, I960; Bullock & Brunt, 1959; 
Driskell & Tremaine, I960; King, Merrell, 
Lovinger, & Denny, 1957; Lindsley, 1956, 
1960; Lindsley & Skinner, 1954; Peters & 
Jenkins, 1954; Tilton, 1957; Verplanck, 
1956) use as dependent variables changes 
in behavior which may be termed "thera- 



peutic." An illustration of this is the work 
of Ferster (1958) and Ferster and De 
Myer (1961) with autistic children in 
which the conditioning of motor operants 
is used to shape up and bring into contact 
with his environment the behavior of the 
autistic child. A series of investigations 
with children as Ss further illustrate the 
use of motor and verbal operant condi- 
tioning techniques in behavioral analysis 
and in "therapeutic manipulation" of be- 
havior (Azrin & Lindsley, 1956; Baer, 
I960, 1961; Bijou, 1955, 1957; Bijou & 
Baer, 1961; Bijou & Orlando, 1961; 
Lovaas, 1961; Patterson, 1959; Patterson, 
Helper, & Wilcott, I960; Warren & 
Brown, 1943 ) . Other recent developments 
have included the application of operant 
conditioning techniques to: the "rein- 
statement" of verbal behavior in psy- 
chotics (Isaacs, Thomas, & Goldiamond, 
I960); the control of stuttering (Flana- 
gan, Goldiamond, & Azrin, 1958, 1959); 
and working with "unreachable cases" 
(Slack, I960); and the shaping of a wide 
range of behaviors in schizophrenics by 
appropriate "behavioral engineering" tech- 
niques (Ayllon, I960; Ayllon & Michael, 
1959). 

Viewing research in psychotherapy as 
part of a broader psychology of behavior 
control has other implications which must 
be faced. Many therapists will object to 
having their sacred healing process identi- 
fied with concepts such as "brainwashing," 
sensory deprivation, or "placebos." They 
will refuse to acknowledge that a thera- 
pist can be "programed" to maximize effi- 
ciency in the influencing process. They 
may contend that this is too mechanical 
an approach and as such belongs to the 
science fiction world of Orwell and Hux- 
ley (Skinner, 1948; Vandenberg, 1956) 
but not to the psychotherapy world of 
Freud. However, the research approaches 
cited in this paper are investigating a 
process that occurs every day in the thera- 
pist's office. They demonstrate that this 
process is lawful and amenable to syste- 
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matic approach as part of the interper- 
sonal influencing process. It is conceivable 
that future research will find that this 
process is most effective under certain 
conditions which may utilize: sensory de- 
privation; hypnosis; conditioning tech- 
niques; subliminal stimuli; manipulation 
of antecedent contacts, set, awareness, and 
ambiguity; and "programed" therapists. 
With our goal as therapists to better the 
lives of our patients, to make them more 
comfortable with themselves, and to bet- 
ter their interpersonal relationships } then 
we cannot avoid recognition of our use of 
these techniques, if this is the way peo- 
ple's behavior is influenced. Intrinsically, 
there is nothing evil or unethical in such 
techniques. The task for the research in- 
vestigator is now to determine the most 
effective techniques of behavior control. 
He must also give serious consideration 
to helping develop societal safeguards so 
that these techniques will not be misused 
or exploited for "nontherapeutic" pur- 
poses (Krasner, 196la). This is a far 
more difficult task than any discussed in 
this paper and is worth a "conference" in 
its own right. 
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Discussion of Papers on 

Therapist's Contribution 

KENNETH MARK COLBY, M.D. 



The trouble with my task lies not in its 
size or complexity or indefiniteness. The 
trouble lies in suggesting our next worth- 
while research steps. 

I think we would all agree today that 
the therapist is important. (Indeed, I can- 
not recapture in my imagination a climate 
of opinion which asserted he was not). 
The therapist, as a person and as an ex- 
pert, is certainly pivotal and crucial in the 
process of phychotherapy. But after ac- 
cepting this proposition, what should we 
do next? In deciding what might be 
worthwhile doing, we enter areas of indi- 
vidual opinion based on unspecified ex- 
perience rather than on tested knowledge. 
The opinions I would like to offer are 
grounded in what one might call a his- 
toric-epistemologic image of what we are 
trying to do in psychotherapy research 
and what is happening to us in this 
attempt. 

Psychotherapy is one of the practical 
arts. It is not a science, it is not even an 
applied science. It is a practical art, a craft 
like agriculture or medicine or wine- 
making in which an artisan relies on an 
incomplete, fragmentary body of knowl- 
edge and empirically established rules 
traditionally passed on from master to 
apprentice. The artisan lacks a systematic, 
thoroughly tested or even well-defined set 
of explanatory principles. His scraps of 
knowledge are not simply applied to an 
individual case but interpreted for each 
individual case in accordance with the 
artisan's judgment and intuition. He looks 
to science for help, not to make him an 
applied scientist which cannot be done 
anyway but to elucidate acute difficulties 



in the art. He wants help with failures, 
with troubles, with lapses from the ex- 
pected. When called upon for help, a 
scientist in turn realizes be cannot (since 
life is short and art is long) develop a 
tested explanatory theory accounting for 
every event in a practical art, nor is it 
even necessary. His repertoire of scientific 
procedures is highly limited relative to 
the number of questions which can be 
asked about any subject matter. If a scien- 
tist is to contribute to a problem, he must 
be able to formulate a decidable question 
about it. By "decidable" I mean a question 
which is worded in such a way that there 
are only two possible and incompatible 
answers, yes and no. Guided by the artisan, 
a scientist must select a certain crucial 
problem in the art and judge whether the 
problem is ready for and accessible to a 
systematic inquiry using currently avail- 
able procedures. A scientist hopes to re- 
duce the degree of empiricism in the art 
by finding that some acute problem in it 
can be solved through understanding an 
underlying explanatory principle. Other 
problems in the art will continue to be 
managed by the artisan using judgment, 
intuition, and personal skills. 

A historical illustration of this relation 
between science and practical art involved 
Pasteur and wine-making. Wine-makers 
came to him for scientific help with the 
problem of souring, turning, and deterio- 
ration of wines. Pasteur discovered these 
undesirable alterations in wine were due 
to the presence of living organisms 
mingled with yeast cells. The next step 
consisted of killing these microorganisms 
by heat sterilization of the wine. Out of 
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this attempt to elucidate a crucial diffi- 
culty in a practical art developed the sci- 
ence of bacteriology, the germ theory of 
infections, and ultimately great mastery 
over certain infectious diseases. If Pasteur 
could not have seen the organisms under 
the microscope nor demonstrated that 
they oxidized alcohol to acetic acid, the 
art of wine-making at that time could not 
have been improved in this way by a 
scientific study. Today wine-making re- 
mains a practical art, and wine still turns 
occasionally in spite of our understanding 
of the process. Empiricism has only been 
reduced, not eradicated, by the discovery 
of explanatory principles. 

I realize one can appeal to the history 
of science to support almost any position, 
and one can use history as a guide to 
almost any future. But I would like to take 
the position at this time that in our re- 
search efforts in psychotherapy we should 
attempt to elucidate specific crucial diffi- 
culties in the art. Charts for the terrain 
of these difficulties must be provided the 
scientist by the artisan. To construct 
itineraries for fruitful relations between 
sicence and practical art we must first try 
to identify those crucial points at which 
current science, with its limited stock of 
conceptual and manipulative procedures, 
has a good chance at an attainable answer 
rather than attempting, in the Greek tra- 
dition, to swarm all over the whole sub- 
ject matter searching randomly for an 
all-encompassing explanatory principle in 
a futile effort to make scientific that which 
is neither ready nor amenable to become 
so. Dr. Strupp, in his paper, has empha- 
sized that we are faced with problems of 
strategy, or research philosophy, of de- 
ploying our resources. I would like to echo 
his feelings that every research project 
we undertake involves a commitment of 
part of our time, our energies, our lives. 
Just because we now have lots of dollars 
to spend in research does not mean we 
can squander our energies and our pro- 
ductive scientific years. 
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Since I am only one-half clinician and 
two-thirds behavioral scientist, I well 
know that such general preachings and 
imperatives can become dreary to re- 
searchers who go their own way and do 
mainly what they want to do anyway. So 
now I shall try to articulate my particular 
viewpoint as specifically as I can in terms 
of the papers by Dr. Betz, Dr. Strupp and 
Dr. Krasner on the therapist in the treat- 
ment process. 

If this artisan represents an essential 
factor we are interested in, what are diffi- 
culties in him we might want scientific 
help in elucidating? Can we first identify 
a difficulty, clarify it through thought and 
discussion, and then fromulate a deddable 
yes or no question about it? 

It appears an important difficulty has 
been clearly and adeptly identified by Dr. 
Betz in her study of doctors working with 
schizophrenic patients. As you have read, 
A doctors do much better with schizo- 
phrenic patients than B doctors. In search- 
ing for an explanation of this difference, 
Dr. Betz has found that A doctors show 
the interests of a lawyer and a CPA, while 
B doctors show interests of a printer and 
a mathematics-physical science teacher. 
Dr. Betz in her paper welcomes critique 
and also asks for an "imaginative ap- 
praisal" of implications of her work. I 
have a slight criticism and a slender im- 
plication in mind. Neither of them, how- 
ever, is particularly imaginative. 

My criticism is that the category desig- 
nated "schizophrenic illness" is not con- 
trolled for homogeneity among psychia- 
trists. Now that the stigmas of poor prog- 
nosis and untreatability have been less- 
ened, more and more patient-states are 
classified as schizophrenia, and a class 
which has never been well-defined has 
been recently expanding its boundaries to 
include less ill people. There is no agreed- 
on rule in psychiatry to tell us whether a 
patient belongs in the class "schizo- 
phrenia" or not. There is no consensus as 
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to what limits are to be put on the inclu- 
siveness of the term "schizophrenia." 
There is great variability among psychia- 
trists, among clinics, among different parts 
of the country, and among different coun- 



tries. 



The expanding inclusiveness of diag- 
nostic criteria might account for the Table 
7 in Dr. Betz's paper which indicates a 
great rise in improvements rates during 
the second 8-year period from 1952-1959. 
I mention this as a possibility, but I do 
not think it is very likely. Her explanation 
that in this second 8-year period there 
were twice as many A doctors at the hos- 
pital seems much more plausible to me. 

In spite of my doubts about the pre- 
cision or even usefulness of the category 
"schizophrenia" I do not doubt Dr. Betz's 
finding that some doctors do better than 
others with severely ill patients. A doctors 
are described as expecting and respecting 
spontaneity, while B doctors restrict spon- 
taneity. This is a cogent description of 
the trouble with certain therapists. It 
matches my own experience in consulting 
with residents and young psychiatrists. It 
suggests an implication which could be 
put in the form of a hypothesis, namely, 
that B doctors are more frightened by 
those patients who tend to lose control, 
to become violent, to express bizarre 
thoughts, to communicate in deranged 
nonsequiturs. A commonly understood 
motive in becoming a psychiatrist is the 
need to master counter-phobically an 
anxiety which arises from being in the 
presence of a person out of control. Such 
a mastery can be achieved in small re- 
peated doses in situations regulated by 
one's own control as is found in thera- 
peutic work with mentally ill patients. 
A and B doctors do equally well with less 
threatening illnesses. But with patients 
who have actually gone out of control or 
who are thought to have a propensity for 
doing so, B doctors become more scared 
and defend against this anxiety by at- 



tempting to exert external control. They 
curb spontaneity in sicker patients since 
they see spontaneity as a dangerous step 
towards the materialization of a dreaded 
out-of -control figure. 

Such a hypothesis, while plausible, 
leaves us with n minus 1 other plausible 
hypotheses. How might one proceed to 
test such notions? Ideally in science we 
would like to test hypotheses by experi- 
ment, but Dr. Strupp has raised some well- 
posed questions regarding the limitations 
of experimental methods in our field. Ex- 
periment has in the past been a powerful 
collateral aid to many practical arts. In 
consulting the textbooks of course one 
finds only a record of the success of ex- 
periments. Some problems have turned 
out to be too hard for experimental 
methods, while others, to begin with, can- 
not be reduced to a necessarily simplified 
and precisely specified experimental situa- 
tion. 

The best critic of his own work is a 
man who has thoroughly thought it out, 
and Dr. Strupp's paper exemplifies this. 
His extensive experience with an impres- 
sive research program has led him to a 
balanced criticism of himself and others. 

He points out, in paragraph numbered 
3 of his paper under the section "Some 
Problems of Research Strategy and 
Methodology," that there has been a de- 
clining interest in naturalistic observation 
of the psychotherapeutic process, although 
this was the initial source of most of 
the useful hypotheses we have today. 
Here again, it seems to me, we have in 
focus those functional relations which can 
hold between scientific approaches and a 
practical art. If we consider a therapist to 
be an artisan and, as Dr. Betz has indi- 
cated, some artisans perform significantly 
better than others, why don't we method- 
ically study the on-going mental opera- 
tions of that artisan, his flow of associa- 
tions, while performing his task? This, in 
my opinion, represents a glaring gap in 
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our knowledge which could be filled in by 
naturalistic and experimental observation. 
The design would involve a therapist de- 
scribing out loud the moment-to-moment 
sequences of his mental states as he listens 
to the sequential descriptions of a patient's 
self-observation. It should be an intensive 
design running through stretches of time 
long enough to capture the stochastic 
properties of both therapist and patient 
state-sequences. In this manner we can 
study not only the interactional but trans- 
actional nature of psychotherapy in which 
a patient has a reciprocal influence on a 
therapist, even affecting his personality in 
a time-enduring way. I am referring here 
in passing to those small partial identifica- 
tions which therapists make with certain 
patients and which every honest therapist 
can detect in himself, long after the ter- 
mination of therapy, in the form of 
minute but unmistakable residues of his 
occupational experience. 

As a groping experimentalist I share 
some of Dr. Strupp's discontent with our 
results thus far. We are discontented, per- 
haps, but not disgruntled. We should 
really blame ourselves rather than inherent 
limitations of experiment or an unwieldy 
subject matter. It seems to take long years 
of patient, primarily qualitative experi- 
mental work before a discipline can sort 
out and make inroads at those points 
where experiment will have its greatest 
yield. We are still moving, striving, inch- 
ing along, trying out, and abandoning 
various experimental directions. Hilbert*s 
advice for mathematical discovery was to 
make a lot of beginnings. I believe we 
are still in the phase of doing the neces- 
sary eliminarive groundwork, and it may 
be that all these results will eventually 
prove negative or of little consequence. 
It is no secret among us that the crisis in 
behavioral science consists of the fact that 
time-honored methods of physical sciences 
and the tools of conventional mathematics 
have not advanced us much in dealing with 
persons. Perhaps we have not exploited 
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these methods intelligently enough, or 
perhaps we have already exhausted their 
yield in the domain of persons. 

If only we could summon up greater 
ingenuity in the application of classical 
methods. Or alternatively, if we could de- 
velop some new perspective, invent some 
new angle of approach, construct a more 
serviceable paradigm theory to guide our 
research. Beginning efforts in this latter 
direction, I shall suggest, may be implicit 
in the imagery of Dr. Krasner's title "The 
Therapist as a Social Reinforcement Ma- 
chine" and I am stressing the word 
"machine." 

It may seem contradictory to you to 
hear someone who has been emphasizing 
therapy as an art now encourage a look at 
machines, since a machine appears anti- 
thetical to anything which might be 
termed art. But let us give Dr. Krasner's 
concept of a therapist as a social reinforce- 
ment machine some moments of cool at- 
tention. (I say cool because the issue of 
machines in human behavior arouses strong 
emotions which can be noted at dinner 
parties of both clinicians and chi-square 
scientists.) 

Dr. Krasner suggests that we view the 
psychotherapist as a controller of behavior 
whose influence is achieved through the 
mechanism of generalized reinforcement 
and then gives us an excellent review of 
the documented work using this approach. 
Some therapists might not like this image 
of themselves as influencers and con- 
trollers, perhaps since it connotes some- 
thing which has been considered disrepu- 
table in the history of psychotherapy, 
namely, suggestion. Suggestion has had a 
sinister connotation of influencing a per- 
son against his will, without allowing him 
to bring his critical faculties to bear on 
what is being done, often to his detriment 
rather than benefit. But there should be 
no objection to viewing a therapist as an 
influencer. Influence is not necessarily a 
term of opprobrium. The therapist does 
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attempt to influence a patient, and the 
patient wants him to; otherwise, he would 
not be there. The modern exploratory 
psychotherapist tries to design treatment 
in a way that the patient does participate 
and does use his critical faculties in sub- 
jecting what is done to rational inquiry. 
We have some degree of control and in- 
fluence over a patient. When it comes to 
psychotic and neurotic states I certainly 
wish we had greater influence than we do 
in relieving persons of this type of mental 
suffering. The difficulty seems to be, 
granted that we influence and control, 
what is effective and what are its mechan- 
isms of action? 

That a mechanism of action involves 
reinforcement I find plausible enough, but 
it does not go far enough to be a satis- 
factory explanation. I shall be as unspar- 
ing of psychology as I have been of psy- 
chiatry and say that the criticism I have 
for the category "schizophrenia" I also 
have for the category "reinforcement." 
What is to be included under this term 
and what are the limits of the category? 
It lacks specification of detail and is 
neither exclusive nor exhaustive enough. 
If everything one person says or does to 
another qualifies as reinforcement, then 
the category is too general to be useful. 
Also missing in the reinforcement view 
of therapy is an explicit answer to the 
question, what is being reinforced by a 
therapist? Hopefully the probability of 
every response is not being strengthened, 
since this would accentuate the imbalance 
of an already unstable system. One might 
say that in therapy we are extinguishing 
neurotic responses while strengthening 
healthy responses. But this crude a 
dichotomy would be too vague, too global 
an attempt to differentiate response 
classes. It may remove the mysticism from 
therapy, but it does not remove the mys- 
tery of the beneficial effect of person on 
person, at least for me. 

Experimental work in operant condi- 
tioning certainly strongly supports the 



view that we can influence behavior in 
therapy. But in clinical discourse what is 
it that is effective and in what direction 
does this influence operate? The proba- 
bilities of behavior strengthened in 
therapy seem to involve response classes 
far more vital and combmatorially com- 
plex than the frequency of plural nouns 
or an increase of self-references. The 
strengthening of these latter response 
classes has been demonstrated first per- 
haps since they are easiest to measure. 
But in clinical discourse when a therapist 
says to a woman "you try to weaken a 
strong man in revenge for your father 
leaving you" and the patient responds for 
20 minutes with affectively intense, shift- 
ing, but colligated associations to this 
utterance, we find ourselves in a maze of 
response classes of quite a different order 
of magnitude. In this situation of a series 
of compound inputs, of a continuous flow 
of associational information, of long 
sequences of utterances bearing meanings, 
of the processing of meaning through an 
exchange of messages, reinforcement 
theory is at present too abstract. For this 
situation, in which the factors are singu- 
larly plural, we need a greater specifica- 
tion of detail, a greater concern with the 
meaning of utterances, a facing up to the 
semantic problem of two-person discourse. 
It is at this point, to return to the last 
term in Dr. Krasner's title, that a ma- 
chine, the computer or a computer-like 
artifact, might help us. 

Again let us identify a crucial difficulty 
of the therapist which prevents him from 
doing more, from being more effective. 
He often finds himself lost in the great 
mass of semantic information provided by 
a patient in the course of therapy. In 
building up his internal working model 
or imago of a patient, he uses dozens of 
categories and stores in them hundreds, 
even thousands, of items. At any given 
moment only a fraction of this model is 
accessible to working retrieval by the 
therapist, not necessarily because of neu- 
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rode factors in him although this can 
happen but because of intrinsic human 
limitations in processing large amounts of 
information. Therapy bogs down and 
often reaches an impasse when a thera- 
pist, more a sink than a source of infor- 
mation, seems to have exhausted the con- 
ceptual alternatives, when he cannot find 
a new heuristic, a way of reducing the 
search space, in order to advance his 
working model and to aid the patient in 
an increasing access to unrecognized but 
highly consequential nonrational beliefs. 
The therapist seems unable to get through 
to the patient with utterances of incisive 
significance to him. Could a computer be 
used as a research tool to investigate this 
problem? Could we simulate a therapist's 
mental operations by means of a computer 
program which contains the desired com- 
binatorial complexity far greater than that 
which can be handled by ordinary verbal 
and statistical techniques? Would this be 
of any practical use? the clinician in me 
asks. I don't know, it might be the basic 
scientist in me answers. Certainly we 
should try to find better ways of reaching 
patients with spoken inputs which have a 
greater impact on them. We all sense that 
in therapy we are not fully utilizing the 
potential of person-on-person effect. We 
are missing something due perhaps to our 
own limitations as information processors. 

Using computer metaphors, let us say 
that persons are programed, like machines, 
by experiences with other persons who in 
turn have been programed by still other 
persons. Where this all begins sounds like 
the chicken and egg problem, but this has 
never seemed to be much of a problem to 
me as long as one specified which chicken 
and which egg. If therapists modify the 
programs of patients, the research advan- 
tage of a computer program as a model of 
this process is that it is highly explicit, 
operational, and can be experimentally 
tested within a reasonable time using a 
set of understood physical mechanisms. 



This is not the place nor am I the per- 
son to elaborate on the advantages and 
limitations of this machine perspective. 
When we make such analogies we hope 
to increase our knowledge of at least one 
of the analogous pair. In the machine- 
therapist analogy we may be finding out 
more about what we believe a machine is 
rather than what we believe a therapist is. 
But as children of our time, it is difficult 
not to be excited by the computer and the 
possibilities of adapting it to aid us in 
coping more successfully with the proble- 
matique of psychotherapy. 

I feel Dr. Krasner is quite correct in 
stating that psychotherapy represents only 
one aspect of the general problem of 
behavior and person control by means of 
communication. Elucidating difficulties in 
psychotherapy may contribute to an en- 
tirely new science of independent status, 
a science of persons as information proc- 
essors, as Pasteur's discovery of micro- 
organisms in wine helped the wine- 
making art somewhat but mainly con- 
tributed to the new science of bacteri- 
ology. If this is so, and particularly if 
computer-like machines fulfill their sense 
of promise, we must consider Dr. Kras- 
ner's final ethical warnings very seriously 
or we in the humanistic sciences will be 
caught unprepared for the social and 
political consequences of our work as were 
atomic scientists 25 years ago. To compare 
ourselves now with atomic scientists 
represents perhaps a presumptuous and 
prestige-borrowing overvaluation of our 
powers. But the more I witness of the 
population explosion, the more I read of 
the exponential increase of scientific work, 
and the more I learn about the speed, 
storage, learning, and creative capacities 
of the computer, the more I wonder if we 
shall be prepared. 

At the start of my discussion I men- 
tioned that our trouble lay in deciding 
the next worthwhile research steps in 
studying therapists. I commented on those 
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fruitful relations which historically have 
held between a practical art and science 
and suggested we use our knowledge of 
them as charts for these steps. Then I 
offered opinions as to what two of the 
next steps might be in (a) studying the 
therapists working mental operations and 
(b) simulating them in mind-like arti- 



facts such as computer programs. These 
suggestions obviously stem from personal 
commitments which I am prepared to 
defend, to reinforce, or to abandon in the 
course of our group discussions. If they 
must be abandoned, I would certainly 
hope to go home having acquired some 
better ones. 



Group Discussion of Papers 
DR. J. McV. HUNT, presiding 



Therapist's Contribution 



DR. HUNT: I find myself wondering 
if it would not provide the best use of our 
time to give the authors of the four papers 
an opportunity to respond to Dr. Colby's 
remarks before we open the circle to per- 
mit general discussion. I should like to 
start by calling on Dr. Betz. 

DR. BETZ: I will speak briefly to the 
comments on my studies. The matter of 
homogeneity and diagnosis is an impor- 
tant one about which it is difficult to get 
perfect agreement among clinicians. The 
criteria in our clinic are, I would think, 
roughly the same as those in other com- 
parable American university hospitals, 
perhaps somewhat on the conservative 
side. In addition to diagnosis based on 
clinical manifestations, we also utilize 
what we call a "personal diagnostic formu- 
lation." This involves taking into consid- 
eration certain personal issues or inter- 
personal difficulties which seem crucial in 
producing the clinical manifestations. For 
instance, a difficulty in establishing a non- 
oppositional relationship with another 
human being, so that aloofness or sepa- 
rateness are conspicuous interpersonal 
features, weighs heavily with us toward 
the schizophrenic diagnosis. Our main 
concern in these studies has been for re- 
liable comparability between the patients 
treated by doctors with high or low suc- 
cess rates. To assure comparability, we 
used a common standard for the two 
groups, official hospital records. In our 
hospital case records, the diagnosis and 
condition on discharge are written into 
the record, at discharge, not by the pa- 
tient's therapist, but by the Chief Resi- 
dent in Psychiatry, after consultation with 



the staff and with the approval of the 
Chief of service. 

At the present time, Dr. Astrup, from 
Oslo, Norway, who is spending a year in 
our clinic, is making an independent diag- 
nostic survey of our research case records, 
following Langfeldt's distinction between 
true schizophrenia and schizophreniform 
psychosis. This will provide an oppor- 
tunity to compare our diagnostic practices 
with those of the Scandinavian psychia- 
trists. 

Dr. Colby's hypothesis that the B doc- 
tors may be more frightened by patients 
who lose control, and so perhaps curb 
spontaneity in the sicker patients has a 
valid ring. In counseling doctors with a 
view to assisting them with their schizo- 
phrenic patients, one can often discern in 
some who are having difficulties, a more 
marked uneasiness in their contact with 
the patients, than in others who are not 
much bothered by the same type of be- 
havior. The B doctors often have a good 
deal of intellectual understanding of what 
needs to be done, and perhaps how to go 
about it, but have difficulty in implement- 
ing this understanding when with the 
patients. They seem more able to think 
about what has gone on with the patient 
after the f act rather than while events are 
in progress, whereas the A doctors can 
participate rather immediately in inter- 
change with the patient. This seems to me 
a phenomenon of considerable interest, 
meriting further study. 

DR. HUNT: Thank you, Dr. Betz. I 
know many of you would like to ask 
questions or make comments. So would I. 
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But let us hear next Dr. Krasner's re- 
sponse to Dr. Colby's remarks. 

DR. KRASNER: While listening to 
and enjoying Dr. Colby's paper, I had my 
pencil poised to reply to the comments I 
anticipated he would make about my 
paper. Much to my surprise, I agreed with 
most of what he said. 

First, I want to clarify my view of the 
nature of the studies described in my 
paper. Conditioning studies have been 
termed "laboratory" studies or experimen- 
tal analogues of psychotherapy. I feel that 
these terms may be misnomers. Most of 
us are so involved in the psychotherapy 
process, both in research and in clinical 
practice, that there has developed an aura 
of sacredness about the process. For ex- 
ample, in Dr. Strupp's fine paper there is 
almost a note of apology that his research 
was not done in the actual therapy situa- 
tion. Many investigators imply that the 
process of psychotherapy, as now prac- 
ticed, is the royal and only road to chang- 
ing people's behavior. The yardstick for 
the acceptability for research then be- 
comes "how close is this to the real psy- 
chotherapy process?" I feel strongly that 
we are losing sight of the purpose of 
psychotherapy, which is to change peo- 
ple's behavior. The purpose of psycho- 
therapy is not "to do" psychotherapy, as 
such. Therapists often write and talk 
about psychotherapy as an important 
process from which they obtain consider- 
able satisfaction. It is good for the thera- 
pist to enjoy psychotherapy and to feel 
that he is doing something important, but 
this is not the purpose of psychotherapy. 
The apologetic tone in papers which ex- 
perimentally investigate behavior is un- 
called for. These so-called laboratory 
studies have important implications for 
the psychotherapy process and derive 
some of their hypotheses from psycho- 
therapy. However, I am less and less in- 
clined to call them "experimental ana- 
logues" of psychotherapy. Rather, I see 



them as part of a broader psychology of 
behavior control which is oriented toward 
devising techniques for the deliberate 
control, manipulation, and change of be- 
havior. I would agree with Dr. Colby's 
point about the inconsequentiality of 
plural nouns. In our own studies we use 
emotional words primarily because of 
hypotheses derived from psychotherapy. 
But our basic aim is not to create an 
analogue of psychotherapy, but to devise 
techniques of behavior control. 

I would also agree with Dr. Colby's 
comments about the apparent inadequa- 
cies in current reinforcement theory com- 
pletely explaining psychotherapy. I have 
the same reaction to papers which "ex- 
plain" psychotherapy in learning terms. 
"What is accomplished in such papers is 
the substitution of one brand of explana- 
tion for another brand. I do not think that 
this is what we are doing in these operant 
conditioning studies. We are not trying 
"to explain" psychotherapy. We are not 
saying psychotherapy is a reinforcement 
process and these are the studies that 
prove it. Rather, we are saying that 
operant conditioning studies are rekted 
to studies in brainwashing, hypnosis, atti- 
tude influence, psychotherapy, and other 
subbranches of a more general psychology 
of behavior control. 

Of course, the kinds of terminology 
used in behavior control studies often 
cause strong reactions from therapists. I 
have received a number of reactions from 
therapists to my paper which include: "I 
enjoyed reading your paper but I dis- 
agreed with everything in it." "Why do 
you use words such as 'machine/ 'manipu- 
lation,' and so on?" These are words that 
make therapists very uneasy. Although 
Dr. Colby admits that it is pretty well 
agreed that therapists do control behavior, 
many therapists really do not accept this 
notion. They refuse to acknowledge that 
they are actually manipulators of behavior. 
I would call it the "look, no hands" phe- 
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nomena: "I am not really doing anything 
to you/' Manipulation and control are 
words which go against the therapist's 
grain. 

There are two other points I would like 
to make: one concerning training, the 
other ethics. I think that operant condi- 
tioning studies have major implications 
for training, both in psychotherapy spe- 
cifically and psychology in general. There 
are many implications of these studies for 
the programing of future therapists. I 
might also add that for better or worse, 
operant conditioning has a strong attrac- 
tion for students doing doctoral disserta- 
tions, and I suspect there will continue to 
be a veritable flood of such dissertations. 
In any case, the kind of thinking involved 
in these studies will have an important 
influence on the training of future psy- 
chology graduate students. 

One final point, which Dr. Colby has 
made, and which I would like to empha- 
size: in investigating behavior control, 
there must be concern with ethical and 
value problems. Many investigators feel 
that to "manipulate" behavior is "bad." 
Carl Rogers, for one, has contended that 
to manipulate is to destroy. Within the 
last few years we have seen an increasing 
growth in behavior control studies: brain- 
washing, sensory deprivation, condition- 
ing, and use of drugs. Psychotherapists 
increasingly are becoming interested in 
conditioning techniques as evidenced by 
the growth of interest in Wolpe's and 
similar work. Razran has recently written 
a fine paper on Russian conditioning tech- 
niques. You may have seen an article in 
a recent issue of Harpers which expressed 
concern about where research in psychol- 
ogy and psychiatry was headed and tried 
to anticipate the potential dangers to man- 
kind inherent in studies of behavior con- 
trol. Most of the studies in these areas are 
preliminary, and there is a long way to go 
before there is a really effective psychol- 
ogy of behavior control Yet we must 



give serious thought to the long-range 
implications and potential dangers in 
these kinds of studies. As a matter of in- 
terest, Oppenheimer some years back 
raised this very point and said that the 
danger to society inherent in investigation 
of techniques of behavior control is 
greater than investigations in the atomic 
energy area. If we conceive of the psycho- 
therapist as a behavior controller, then the 
question of his ethics and value systems 
becomes of crucial importance. Further, 
the problem is whether you can investi- 
gate values through behavioral analysis. I 
think that it can be done, and we are 
trying some preliminary approaches to 
this problem. But, again, I think thera- 
pists are deceiving themselves if they are 
unwilling to face the issues here. There is 
now enough evidence to clearly show that 
the therapist value system cannot be kept 
out of psychotherapy. 

DR. HUNT: Thank you, Dr. Krasner. 
Although I am tempted again to open the 
floor for discussion now, because I find 
myself wanting to ask questions and I 
suspect that all of you are pretty much 
like me, I shall repress this impulse (I 
can see by the expression on Dr. Shakow's 
face that it would technically be more 
correct for me to say suppress this im- 
pulse), and I shall ask Dr. Strupp for his 
response to Dr. Colby's remarks. 

DR. STRUPP: Thank you. I would 
like to keep my comments brief to give 
others an opportunity. I was very much 
intrigued by two points in Dr. Colby's 
paper, namely: (a) his recommendations 
for the next steps involving naturalistic 
observations of expert craftsman thera- 
pists as yet we have too few observations 
of this kind and () his reference to 
experiments simulating the therapists' 
operations. I'd like to make a few observa- 
tions about this. 

First, the difficulties in naturalistic ob- 
servations have been set forth extremely 
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well in Dr. Butler's paper. He points out, 
among other things, that in making 
naturalistic observations you adopt already 
a frame of reference, a theoretical frame- 
work, and it is very difficult to make ob- 
servations without being committed in 
advance to a definite point of view. Thus, 
one runs the danger of merely observing 
what one wants to observe or what one 
has already decided to observe. 

Moreover, there seems to be a great up- 
surge of interest on the part of many re- 
searchers in naturalistic observation. I 
believe it was Dr. Luborksy, who pointed 
out in his Annual Review article a couple 
of years ago, that there has been a marked 
decline in good case history studies based 
upon naturalistic observation in clinical 
situations. However, during the past 2-3 
years there has been a renewed interest 
along these lines. The study by Scheflen 1 
of Dr. Rosen's work and the research con- 
ducted by Dr. Franz Alexander's group, 
and Dr. Shakow's group are good exam- 
ples of this trend. This brings me to a 
basic question in this area, namely, experi- 
mentation versus naturalistic observation. 
I think we have more and more turned 
away during the last few years from crude 
ad hoc quantifications and from what I 
consider premature experimental at- 
tempts; rather, we prefer to look first 
more closely at the phenomena. This, I 
believe, is a very salutary development, 
because in many ways experimentation in 
this area is decidedly premature. The con- 
ceptualization of many experiments, espe- 
cially in the verbal conditioning area, 
reveals a great hiatus between the clinical 
phenomena and the experimental opera- 
tions; all too often, it seems to me, trans- 
lations are very loosely made, and there is 
not sufficient understanding on the part 
of the experimenters of the clinical phe- 
nomena. The choice is not between ex- 
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periments and naturalistic observation 
dearly we are not dealing with an "either ' 
or" proposition but I believe we still 
have a great deal to learn from naturalistic 
observation, and it is a good thing that 
some of us are coming back to it. 

DR. STEVENSON: I'd like to ask Dr. 
Betz a question. Dr. Betz, I was interested 
in Dr. Astrup's review of your cases, hav- 
ing in mind particularly other studies in 
Norway by Professor Langfeldt about dif- 
ferent prognoses of these two types of 
schizophrenic-like illnesses, and as you 
know from Professor Langfeldt's work, 
which I think Dr. Astrup has also con- 
firmed, the prognoses of what they call 
schizophrenia and schizophreniform psy- 
chosis is markedly different. 

DR. BETZ: That has been the prevail- 
ing viewpoint, carrying with it a certain 
fatalistic implication about prognosis for 
the "process" schizophrenia group. It has 
the implication that this group, perhaps 
on a genetic or constitutional basis, is so 
constituted that effective therapeutic in- 
tervention is not possible. As more knowl- 
edge is gained, in dynamic terms, about 
this group and about therapeutic condi- 
tions favoring good outcome, this assump- 
tion may prove not to be absolutely valid. 
A somewhat analagous therapeutic out- 
look can be found in late nineteenth cen- 
tury medical textbooks about pernicious 
anemia and diabetes. Better knowledge 
about the nature of these illnesses has 
justified a more favorable prognostic view 
of these disabilities. One implication of 
the Phipps studies on schizophrenia is 
that what happens next may be more im- 
portant than what has gone before, genet- 
ically or experientially. A potentiality to 
overcome a constitutional handicap may 
be present, if it can be elicited by appro- 
priate therapeutic intervention. 

DR. STEVENSON: I hadn't really 
reached my question, which is related to 
what I was saying about the different 
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prognoses in different groups of patients. 
I have wondered whether or not your resi- 
dents had any influence on the selection 
of the cases assigned to them. 

DR. BETZ: No. 

DR. STEVENSON: I have been mak- 
ing some naturalistic observations of our 
residents, and it does seem that certain 
residents do select out certain kinds of 
patients, and they can influence the chief 
resident to channel certain kinds of pa- 
tients in their direction and shift patients 
sometimes after the original assignment. 
I don't know to what extent this is a 
factor, but I wondered whether you had 
gone into this. 

DR. BETZ: We have avoided shifting 
patients from one doctor to another. Our 
studies have been naturalistic rather than 
experimental 

DR. STEVENSON: Well, is your 
assignment completely randomized? 

DR. BETZ: The assignment is random. 
The policy is for strict rotation. If there 
are occasionally little leaks in that, I don't 
think it is enough to count. 

DR. HUNT: The First Conference on 
Research in Psychotherapy started with a 
great deal of emotionally loaded fencing 
back and forth among us participants, but 
it ended with a high level of communica- 
tion among us. This communication was 
partly emotional We achieved a stage 
where you could express an idea without 
fearing that someone would take a deva- 
stating poke at it, or at you. The com- 
munication was also substantive. I believe 
a considerable share of the change which 
I saw taking place during that first con- 
ference has endured and is to be found in 
the manner in which we are starting 
today. We appear to be starting this con- 
ference at the same high level of mutual 
confidence and understanding at which 
we ended three years ago. 

As our authors have been responding 
to Dr. Colby's remarks, various of you 



have indicated to me that you have ques- 
tions to ask or comments to make. I have 
been putting your names down here. I 
have the largest number of names under 
my notes on Dr. Krasner's responding 
remarks. 

DR. SNYDER: I would like to address 
my remarks to Dr. Krasner. I found his 
article exciting, intriguing, stimulating, 
interesting, and everything else! I very 
much appreciated it, but I think I should 
say that, while he points out a fascinating 
idea, and discusses the similarity of these 
manipulative techniques to psychotherapy 
(and so far as that goes, isn't every human 
action a manipulative technique?), the 
differences are not brought out the fact 
that brainwashing and psychotherapy are 
very different, also. For example, most 
people who are brainwashed are having 
this process done to them whether they 
want it or not in fact, when they do not 
want it. Secondly, they are forced to do 
something that is not in line with what 
they conceive to be for their own good, 
which is different from what happens in 
much psychotherapy. So that I think the 
analogue cannot be considered total and 
complete; we still have differences, and I 
would be inclined to say, "Thank God, we 
aren't brainwashing yet Let's try to avoid 
it." 

DR. KRASNER: My reaction is to 
agree with you. I think that there are a 
number of similarities which cannot be 
ignored. However, this adds to the im- 
portance of investigations in this area 
which seek to determine both the ele- 
ments of similarity and dissimilarity. To 
stress the ethical problem again, it is 
necessary for investigators with "good 
ethics'* to learn more about these con- 
trolling techniques so that they can be 
used for the "good" of mankind. That 
there are some inherent dangers in these 
kinds of studies has been stressed previ- 
ously. However, research in these fields 
must be, and will be, continued. What 
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we are stressing is the need for thought 
to be given to the social applications and 
implications of these researches. To com- 
ment on the point about "doing some- 
thing to a person against his will," isn't 
there a considerable element of this in 
psychotherapy? The person who winds up 
in psychotherapy is usually the person 
who has most consistently and successfully 
fought against having his behavior influ- 
enced via social pressures, and he still 
carries the battle over into the therapy 
situation. As a "naturalistic" observation 
I think that many patients who are in 
therapy do not really want their behavior 
changed, and in this sense, the therapist 
is trying to do something against their 
will. Dr. Frank has some interesting com- 
ments in his excellent new book on this 
viewpoint about psychotherapy and brain- 
washing, and perhaps he would like to 
comment on this. 

DR. BUTLER: I really have a com- 
ment or two, not directly about Dr. Kras- 
ner's paper, but Dr. Strupp mentioned 
naturalistic observations versus experi- 
ment! science. It seems to me that we 
often think of these as being somewhat 
different enterprises and it seems to me 
they can be different enterprises, but they 
shouldn't be. There is a sense in which 
you are going to get out of an experiment 
just what you put into it. Experiments 
test hypotheses; that's good. But they don't 
lead to discovery unless something goes 
wrong, unless there is some sort of a sur- 
prise. In the operant conditioning ap- 
proach there are very precise ideas about 
methods of controlling and shaping be- 
havior. The ideas about human nature and 
the process of psychotherapy connected 
with this approach seem to me not to be 
very precise. I think there should be a 
kind of interplay between observation, 
that is, taking in what is mysterious and 
surprising in such a way that substantial 
hypotheses and theories are contrived. 
These contrivances could then be tested, 



perhaps, in the context of the approach 
Dr. Krasner is advocating. I think for 
some time there should be room for rather 
loose- jointed procedures so that the real 
mysteries can emerge and take form. 
There can be, as I say, a kind of limitation 
of discovery by experimentation; I think 
that possibly is what Dr. Strupp means by 
premature experimentation, experimenta- 
tion based on method rather than on posi- 
tive knowledge. 

DR. LUBORSKY: I would like to 
make a comment, also, about Dr. Krasner's 
survey of research studies. One of the 
crucial necessities, I think, to make them 
more relevant to psychotherapy is the 
understanding of the patient or subject 
that the experimenter or the therapist has 
an interest in helping him. I believe that 
we were all in agreement with Dr. Frank's 
point about the tremendous importance of 
the therapist's intent to help a person and 
the person's recognition of that intent. 
Most or all of the studies you surveyed 
involved a relationship in which a subject 
is to be experimented upon. These studies 
might be more relevant if more of them 
added the helping intent as another in- 
gredient of atmosphere. Otherwise, the 
studies could still be carried out in the 
usual style. 

DR. KRASNER: These studies are in 
their early stages with their potentiality 
limited only by the ingenuity of the ex- 
perimenter. One study I have recently 
heard about is that of Slack, 2 in which the 
operant conditioning approach was used 
to manipulate the usually unmanipulatable 
behavior of juvenile delinquents. This is 
the kind of study that moves in this direc- 
tion. What would be your observation to 
that? 

DR. BORDIN: I think Slack's proce- 
dure represented an ingenious process of 
bringing someone into a cooperative 

2 Slack, C W. Experimenter-subject psycho- 
therapy. Meat. Hygiene, I960, 44, 238-256. 
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relationship leading toward personality 
change under conditions where the kinds 
of persons he was dealing with would 
not ordinarily do so. NOW T , if you recall 
the conditions, he would bring them in 
first as subjects in the experiment, but the 
whole process is one of eventually under- 
mining their doubts about other people 
and their willingness to become part of a 
changed process. Gradually, the subject 
moves into conscious active collaboration. 

DR. SHAKOW: Could I just make a 
comment on what Dr. Butler just said? 
We see so much overemphasis of method 
in psychology doctoral dissertation after 
doctoral dissertation that does not really 
grow out of theory but rather out of an 
elegant and controllable method. I think 
that we should consider the experimental 
approach in the context of the kinds of 
goals which Dr. Butler has just presented 
rather than from the point of view of the 
method, as it has been true so frequently 
in the past, 

DR. BORDIN: May I make a com- 
ment on this once again? I think there 
would be a danger if we did not take ac- 
count of three parts of the process of 
adding to knowledge. One of them I 
would put as curiosity, the second one, the 
kind of creative action in discovery, and 
the third one, the process of verification. 

Now, I think that we underestimate 
and I am responding to Dr. Butler here 
we underestimate the importance of curi- 
osity. In the search for knowledge, we too 
readily assume that going through the 
verification process cuts off discovery. If 
curosity is strong enough, when one fails 
to obtain verification, it can overcome the 
tendency to rationalize the failure and can 
lead to an examination of one's presup- 
positions. The failure to get verification 
should lead to the re-examination of one's 
own fund of naturalistic observation on 
which presuppositions are based, with the 
possibility of discovery coming in re- 
sponse to the failure to verify. So it seems 
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to me that it would be dangerous to 
assume that discovery can only occur in 
the naturalistic observation process. It 
can occur as part of the cycle of verifica- 
tion and modification of hypotheses. 

DR. KRASNER: By using manipula- 
tive reinforcing techniques to obtain our 
goal. 

DR. BORDIN: In general terms. 

DR. BLOCH: I'd like to comment 
briefly on that. I think the Slack work is 
very relevant: one of the questions there 
is who manipulates whom. The purpose 
for which this particular system of paid 
delinquent and conditioning intervener is 
established may very well be for the inter- 
vener to change the delinquent. In talking 
with Dr. Slack about it I had the impres- 
sion that maybe it is the delinquent who 
is interested in proving that the world is 
really a manipulative place and people 
will only use you for their own purposes 
and, indeed, cannot be trusted. The stated 
and open basis on which the agreement is 
reached doesn't contain in it all the sig- 
nificant elements of the transaction. There 
may indeed be other important things 
going on. 

DR. SHLIEN: As Dr. Bloch says, there 
is a moot question of who is manipulating 
whom. The patient is probably alert to the 
possibility and nature of rewards, and 
often knows what behaviors he must emit 
to obtain approval, if he wants it. One 
could argue that the patient controls the 
therapist as much as the therapist controls 
the patient, and this might seem to equal- 
i2e matters and take the curse off the 
whole problem of control. I don't think 
so. War is evil even when both sides are 
evenly matched for mutual "influence." 
Further, why assume without question 
that control is necessary and inevitable in 
all interaction, or that direction and con- 
trol are therapeutic and therefore proper 
objects of our study? There may be situa- 
tions in which genuine freedom is pos- 
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sible, and freedom could be therapeutic. 
We might find attention, for instance, a 
generalized reinforcer which enables the 
patient to choose his own adaptation to a 
wider range of problems than we experi- 
mentally present. 

I know that Dr. Krasner is duly sensi- 
tive to the ethical problems. Some of the 
logical problems worry me more. His 
paper has already been called provocative. 
I find parts of it downright outrageous. 
Of course this means it scares me, and of 
what am I afraid? I'm afraid, for one 
thing, that there is an attractive simplicity 
in such work that will lure people into 
mechanical techniques prematurely. I am 
more afraid that because these techniques 
do have some effect we will assume that 
people are predictable and controllable to 
a degree beyond that which they truly are. 
For my part, I feel that if they are really 
predictable and controllable, O.K. go 
ahead and predict and control them to the 
utmost. But if they are not so predictable, 
then it is a crime against nature to set up 
a system which operates wholly on the 
assumption that you can predict and 
control. 

Dr. Krasner suggests that the scientific 
problem is to find techniques whereby one 
can change the behavior of others. To my 
mind, that is a political problem. The 
scientific problem is to find and under- 
stand the internal mechanisms of behavior 
change. Once we know the basic mechan- 
ism, there may be many applications. 

I wonder what Dr. Krasner would think 
about this point. It appears to me that the 
significant factor in change is the inven- 
tion of the operant. Now I understand 
that we are not really talking about true 
operants, but about previously conditioned 
behaviors; however, using this language, 
I would say that the reinforcement is not 
the effective mechanism. It is only the 
external assistance given to a highly sig- 
nificant internal event. When a quiet stu- 
dent finally speaks in class, it may be based 



on an internal decision not yet reinforced 
or influenced by anything the teacher has 
done. What the teacher does next will 
probably influence how much more the 
student talks in the future, but what really 
counts is the invention, the first instance, 
of the operant. I think that is the primary 
element in change, and the emphasis on 
reinforcement seems to me to conceal 
what is primary. 

Finally, I'd like to ask this question: If 
the therapist is a reinforcement machine, 
is the reinforcement machine a therapist? 
That is, if A is equal to B, is B also equal 
to A? If not, and I would guess that Dr. 
Krasner would not say that the machine 
is a human being, then B is not equal to 
A, but only part of A. I would ask, and 
think it very important to know, what is 
left in the therapist not accounted for by 
the machinery analogy. 

DR. KRASNER: Well, I think there 
are three points involved. You are saying 
things that are similar to what Dr. Colby 
said. Implicit in what you are saying is 
that psychotherapy is not really approach- 
able via assumptions that behavior is law- 
ful and predictable. The evidence against 
this idea is quite strong and is supported 
by several of the studies reported here. 
In fact, the basic assumption in having a 
conference such as this one is that there 
are lawful relationships in psychotherapy. 
Whether in the long run you can account 
for all of psychotherapy in such lawful 
terms, or whether there will always be a 
certain amount of "humanity" which we 
cannot get at, certainly remains a question. 
I almost hope that you are right, but I do 
not think that we can assume this. 

Secondly, insofar as the operant is con- 
cerned, again I think you are right. In 
order to reinforce operant behavior, an 
operant must first make its appearance. 
However, you can use these techniques to 
increase the likelihood of such an occur- 
rence. By manipulating instructional set 
you can influence the kind of behavior 
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you want. The same thing of course oc- 
curs in this other situation called psycho- 
therapy. For example, how do you get a 
patient to talk about a specific topic you 
feel is relevant, such as sex? Generally, 
you wait until he says something and then 
you reinforce it. You may ask questions, 
you may probe, but you still aim to influ- 
ence the frequency of this operant be- 
havior after it has occurred. 

Thirdly, I want to comment about the 
therapist being a human being. I do not 
really think that the therapist is a "ma- 
chine" in the sense of being nonhuman. 
There are, however, certain analogies to 
machines that are relevant. I would par- 
ticularly like to stress "programing," 
which involves the training of this thera- 
pist "machine." There have been recent 
studies which have demonstrated that by 
controlling the training techniques you 
can greatly alter the "machine's" behavior. 
I would like to see the kinds of techniques 
I have been describing influence training 
techniques so that there is a greater aware- 
ness on the part of the therapist of what 
he is doing and what he is potentially able 
to do in altering behavior. Does this make 
him any more or less human? Referring 
to the therapist as a "machine" very much 
arouses strong feelings in therapists who 
are kind, warm, helping people. However, 
I feel strongly that by stressing the kinds 
of potential techniques that can make the 
therapist more effective in his task of 
changing behavior, we are fulfilling our 
obligations as therapists and as human 
beings. I would contend almost paradox- 
ically that thinking in terms which are 
optimistic about the potentiality of change 
in human behavior makes us more human. 

I want to make another point that I 
think is relevant here. Most of the studies 
I have cited are being done by clinical 
psychologists. All too frequently there is 
an inclination on the part of "applied" 
people to resent experimental psycholo- 
gists interpreting dinical phenomena by 



RESEARCH IN PSYCHOTHERAPY 

extrapolating from the rats to human 
beings. However, in the operant condi- 
tioning studies most of the investigators 
are trained in dinical work, with the same 
value systems and interests as psycho- 
therapy researchers. I think this fact 
should be noted in evaluating the ''ma- 
chine" conceptualization. 

DR. FRANK: To go back to John 
Shlien and put it most sharply, it seems 
to me that one way to find out just how 
spontaneous people are and what the 
limits of influence are is to try to influence 
them. I think we will find that there are 
real limits. Even the effects of brainwash- 
ing do not last very long when people 
come back to their environment, for 
example. Similarly, when you talk about 
trying to understand the change of be- 
havior one of the ways to understand 
is to try to change it. Kurt Lewin called 
this action research. The most useful ways 
of learning about something is to try to 
modify it because then you know what 
you are introducing into the system and 
you see what happens. Then, finally, I 
would like to ask a question for informa- 
tion. It is my understanding that the 
operant conditioning procedure works 
only on behavior and is not a method for 
influencing emotional states, and in psy- 
chotherapy we are trying to influence feel- 
ings and not just verbalizations. Is this a 
real limitation of operant conditioning or 
is it not? 

DR. KRASNER: I don't think so. One 
of the most important areas of investiga- 
tion is that of the relationship between 
changes in words and simultaneous 
changes in emotions. It would be reason- 
able to assume that if you are changing a 
person's talking about emotions, then you 
are changing his emotions. It certainly is 
worth investigating. Some of this was im- 
plicit in your comments last night. 

DR. STEVENSON: I just wanted to 
touch on what seems to be another im- 
portant point with regard to the operant 
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conditioning studies. This is, that they 
don't demonstrate, as I see it, new influ- 
ences on human behavior but rather how 
it can influence past behavior covertly. If 
you want to have a patient talk about sex, 
one of the best ways is to ask him to do 
so. You can also say "un-hunh" every time 
he makes a reference to sex, but this is a 
very time-consuming way. Several mem- 
bers of our staff are interested in verbal 
reinforcement. We had a woman patient 
who was wearing pants and slacks around 
the ward and we decided that she ought to 
differentiate herself more sharply as a 
woman. We were trying to influence her 
to wear dresses and skirts, and we set up 
an elaborately designed program for the 
nurses to praise her every time she was in 
a dress and to be cool to her whenever 
she wore slacks. While we were getting 
this design established, one of the resi- 
dents, who was rather brusque went to 
the patient and said, "Look, I don't want 
to see you wearing slacks and pants any 
more. Get in dresses and stay in dresses." 
That was all that was required. 

DR. SASLOW: I wanted to say a word 
on a point which Dr. Frank just made to 
Dr. Krasner. I thought of the observa- 
tions of Pisoni and Salzinger in which 
they reinforce affectively laden statements 
and demonstrated that affectively laden 
statements were increased by this simple 
method. You don't have this in mind? 

DR. FRANK: That is different 

DR. SHAKOW: They were affective 
words, weren't they? The words don't 
necessarily have to be laden. There were 
words like "mother" and "home." In dis- 
cussing their paper at the Brussels meeting 
I said, "You've got all affective words, but 
did you have 'affect'?" This they couldn't 
answer. Now, whether they have carried 
out studies later which give evidence of 
the latter I don't know, but thus far all I 
see is the label. 

DR. SASLOW: One other comment. It 



is not an uncommon observation, espe- 
cially when you are teaching younger peo- 
ple, that when a patient gives you a com- 
munication filled with much emotion, it 
isn't difficult to teach a resident to look 
upon the communications as being a 
multilevel message with one level the 
emotional level, another the concept level, 
and so on. You can teach him to respond 
or not to respond to any one or more of 
these levels. If he can learn how to prac- 
tice nonresponse to an extremely hostile 
component of the message or to respond 
to the content without the emotional re- 
sponse, in a very short time you will have 
an entirely different kind of behavior, in- 
cluding some affective change in the pa- 
tient. Subsequently you can reopen the 
topic that you wished to have discussed. 

DR. FRANK: Let me say that I am 
quite sure that we influence our patients. 
I am not sure this is the mechanism by 
which it happens, and that is the only 
question I was raising. 

DR. LENNARD: I think we might 
also consider that the patient in turn in- 
fluences the therapist, even though the 
extent and type of influence may be very 
different. There has been very little work 
on this process, though there is the sug- 
gestion based on studies of doctor-patient 
relationships that the direction of influ- 
ence is not all one-sided. It may not be 
any particular patient who exerts the in- 
fluence but the types of patients seen by 
a physician over longer periods of time. 
For example, physicians whose practice is 
mainly limited to patients of lower socio- 
economic status will in time differ, insofar 
as some elements of treatment procedure 
and approach are concerned, from a 
physician who is mainly seeing a group of 
wealthy patients. Such differences may be 
attributed to the physician's response to 
particular expectations and demands 
which subsequently result in modification 
in procedure and approach. I would not 
at all be surprised if studies of psycho- 
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therapists and types of practice ( in terms 
of their social composition or diagnostic 
specialization) would not yield similar 
findings. I suggest that the influence of 
the therapists* "patient set" upon his 
therapeutic and personal outlook is worthy 
of attention. 

DR. STRUPP: I would like to come 
back to one comment by Dr. Krasner 
which struck me very much. I refer to his 
statement that the typical patient who 
comes to psychotherapy is the sort of per- 
son who for a variety of reasons, which 
often can be traced genetically, has learned 
in childhood to resist social influence (by 
parents and other authority figures) . Now, 
it seems to me that a good part of the 
therapist's effort is directed at breaking 
down these resistive patterns and to show 
the patient that it isn't expedient and 
adaptive to resist authority figures in this 
way. As the patient comes to experience 
that it is in fact safe and that he is better 
off to follow a different path, he becomes 
more open to experience and in general 
he "feels better." All this is by way of 
saying that in breaking down resistances 
the therapist is, as it were, "conditioning" 
the patient explicitly and indirectly at the 
same time. I am also asking, as did Dr. 
Frank, are we conditioning verbal be- 
havior, or are we conditioning emotions? 
Perhaps a method could be devised to 
test this. 

DR. HUNT: I would like to change 
here because we have comments on Frank, 
Colby, and Betz here that I would like to 
come back into. Is there another quick 
comment on this? 

DR. LUBORSKY: Yes, one of the 
points made by Dr. Frank had to do with 
the tiny role of the truth of an interpreta- 
tion in the effectiveness of that interpre- 
tation. I wondered how far he would go 
in maintaining that. One of the hardest 
things in the course of learning to engage 
in psychotherapy is to listen. And I have 



noticed that the patient himself is usually 
listening. When one says something that 
is to the point of what the patient is ex- 
pressing, one gets more response from the 
patient. Your statement was that it is not 
the truth but the belief of the patient that 
is crucial. What I want to add is that cap- 
turing an aspect of the truth will make a 
great difference too. 

DR. FRANK: During the coffee break 
Dr. Colby pointed out that what I was 
saying was a truism. All truth is nothing 
but consensus anyway. I think that the 
point I was making is that we sometimes 
search too hard to find exactly the precise 
and correct interpretation, assuming there 
is something that it applies to, whereas 
what really counts is plausibility in terms 
of what the patient has said and what 
makes sense to you. I suppose this is 
where the skill of the therapist comes in. 

DR. LUBORSKY: It does have a dif- 
ferent ring if stated that way. One hopes 
for at least an aspect of the truth in an 
interpretation; your address included an 
illustration of a very plausible interpre- 
tation. 

DR. MAHL: I was going to ask Dr. 
Frank the same question about his paper 
last night that Dr. Luborsky asked. 

I want to respond to the concern shown 
earlier that there might be many Ph.D. 
theses done applying the operant condi- 
tioning technique to the interview simply 
because there was now a method available. 
Those who expressed concern about push- 
ing the method to the limit implied that 
in principle this would be a bad thing. I 
don't share that concern. As I remember 
Dr. Conant's review of the history of the 
concepts of atmospheric pressure and of 
Boyle's law of gases, these principles 
didn't develop until people had spent 
many years playing around with the ba- 
rometer and with the vacuum pump. Boyle, 
according to Dr. Conant, did studies num- 
bering in the hundreds with the vacuum 
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pump, and as a result of thus pushing this 
method to the extreme he was able to 
arrive at the basic laws of gases. The same 
thing happened with the barometer and 
the concept of atmospheric pressure. 
Freud certainly pushed the "free associa- 
tion" method, applying it to symptoms, 
spontaneous verbal and ideational ma- 
terial, dreams, tongue-slips, lapses of 
memory, "meaningless" acts, etc. When 
he was making his great discoveries, he 
apparently did this at the drop of a hat. 
I think that we shouldn't in principle con- 
demn this massive exploration of a new 
method. We might ask information 
theorists about the ratio of new discover- 
ies to quantity of information input. 

Dr. Colby's discussion prompts the fol- 
lowing comments. His remarks about the 
partial identifications every therapist 
makes with his patients struck a certain 
resonance in me. I wonder if this process 
isn't more important than his brief com- 
ments about it would indicate. Does this 
capacity to make partial identifications in 
a controlled way have anything to do with 
the distinction between Dr. Betz's A and 
B therapists and with the dimension of 
spontaneity and freedom of expression 
Dr. Butler wrote about in his paper? The 
capacity for partial identifications might 
make a therapist more successful It's a 
form of sublimated libidinal tie with a 
patient which I believe is bedrock for any 
successful therapeutic venture. The ana- 
lytic writing on empathy, understanding, 
and the basis for interpretation empha- 
sizes a capacity for controlled identifica- 
tion by the therapist with the patient. It 
is regarded as one of the processes giving 
birth to empathy and one's ability to 
understand the patient. I have wondered, 
Dr. Betz, if you had any observations 
about differences in capacity for con- 
trolled, partial identifications between 
your A and B doctors. 

DR. BETZ: The question is important 
but difficult to answer with evidence. I 



have talked with residents informally, at- 
tempting to learn about what is going on 
in them while they are working with 
schizophrenic patients. From such conver- 
sations I have had some leads. For in- 
stance, one resident who has a high suc- 
cess rate with his schizophrenic patients, 
told me that when he feels in contact with 
a patient, the patient at that moment 
seems to represent to him some prototype 
from his own earlier experience either 
a personal identification, or some person 
who had been important and meaningful 
to him with whom he had felt a very 
sympathetic response. 

What is it that engages the therapist's 
interest in a profound way, so that the 
patient gets some sense of contact? I think 
that it is an important consideration 
what these matters are in the therapist 
that enable this to occur. 

DR. MAHL: But I think this is some- 
thing so important that it would underlie 
many of the profound manifestations of 
the therapist's characteristics and it ought 
to be studied. 

DR. BORDIN: I would like to add 
some suggestions to those that have al- 
ready been made as to where one might 
seek the answer to why it is that these A 
and B doctors seem to have a different 
impact. The suggestions I have to offer 
grow out of work we have been doing on 
how personality factors condition voca- 
tional choice The not very original idea, 
of course, is that the people do choose 
those occupations whose activities permit 
them to indulge in their preferred ways 
of both expressing and controlling their 
impulses and their emotions. Some of our 
research has involved comparisons of 
lawyers with dentists, some comparisons 
of accountants, not CPAs, and creative 
writers, as well as physicists and clinical 
psychologists. I am using my impression 
of what is involved in these occupations 
as developed from this research. One di- 
rection would be to choose which of the 
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possible ways in which the relevant occu- 
pations differ are the crucial ones in terms 
of this therapeutic situation. For example, 
it is obvious that a lawyer makes use of 
words. Is it that the A doctor is more 
verbal? Some of your comments about 
them referred to being able to respond 
and not being at loss for words this is 
changing slightly what you said* This is 
one occupational group. Another one is 
creative writers who on the Strong would 
seem to fall into the same general group 
as lawyers, the verbal group. Research has 
suggested that creative writers are persons 
who were searching for identifications. 
Perhaps part of being a creative writer is 
being able to put yourself in the place of 
other persons, to see the world the way 
other people do. Creative writers seem to 
be, in this case as contrasted with ac- 
countants, persons who did not form a 
very tight identification. The accountants 
seemed to have a very tight identification 
and did not tend to look at the world 
from different points of view; instead, the 
creative writers were the ones who were 
trying on how other people thought, and 
perhaps this is part of this partial identifi- 
cation process. 



Another one has to do with the issue 
of how directly a person expresses his 
interpersonal curiosity. We suggest that 
clinical psychologists, for example, express 
their interpersonal curiosity very directly. 
I have the impression that lawyers do. The 
very practice of law, with its access to 
people's secrets provides this special op- 
portunity. By comparison, the accountant 
mostly has access to people's financial 
secrets, which represents a displacement 
from one of the original sources of curi- 
osity, curiosity about interpersonal rela- 
tionships. This, then, may be another 
factor to consider. 

Another one which I saw as being of 
possible relevance is the willingness to 
respond spontaneously. We see some sug- 
gestions of difference between the ac- 
countant who is much more conventional 
and less free as compared to lawyers, cre- 
ative writers, and apparently clinical psy- 
chologists. I don't know about psychia- 
trists; we haven't studied them. So these 
are the kinds of ideas that strike me as 
possibly being worth pursuing. What you 
have is alternative interpretations of your 
data, and I think this is part of what Dr. 
Colby was talking about. 
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OVERVIEW 

In 1954, after five years of prior plan- 
ning and constructing of instruments, the 
Psychotherapy Research Project of the 
Menninger Foundation took its present 
shape. Despite the numerous "outcome" 
research reports in the literature, we felt 
there was an immense need for an inten- 
sive "outcome-process" research on psy- 
choanalysis and other long-term psycho- 
therapies. We aimed to find and refine 
hypotheses on what changes in psycho- 
therapy and how and why these changes 
come about. 

This is a progress report on some leads 



suggested by a segment of data from the 
Psychotherapy Research Project. An over- 
view of the project is necessary to intro- 
duce the present topic Briefly, our plan 
called for assessment of 42 patients by 
teams of clinicians before treatment, at 
the end of treatment, and two years later. 
Our approach entailed naturalistic obser- 
vation (which implies minimal interfer- 
ence with clinical processes) from three 
angles simultaneously (patient, treatment, 
and therapist, and life-situational vari- 
ables), combined with length of observa- 
tion ( the whole period of long-term treat- 
ment plus a two-year follow-up) and a 



1 This paper is from the Psychotherapy Re- 
search Project of the Menninger Foundation. 
Although analysis of these data and writing 
were done separately in Philadelphia, in a very 
real sense, all 19 members of the Psychotherapy 
Research Project have been co-workers and co- 
contributors (Robert S. Wallerstein, Lewis L. 
Robbins, Gerald A. Ehrenreich, Michalina 
Fabian, Mildred Faris, Helene D. Gerall, Ber- 
nard H. Hall, Leonard Horwitz, T. W. 
Mathews, Martin Mayman, Herbert C Modlin, 
Gardner Murphy, Majorie Orth, Irwin Rosen, 
Helen Sargent, Richard S. Siegal, Ernst Ticho, 
Gertrude R. Ticho, and Harold M. Voth). 
Drs. Robert Wallerstein, Gardner Murphy, 
and Bernard Hall especially contributed sug- 
gestions for final revisions. Dr. Wayne Holtz- 



man has been an active and stimulating con- 
sultant to the project for many years and 
specifically has participated crucially m the 
formulation of this report. Dr. Irving Janis 
and Dr. Albert Stunkard have been over a 
draft of the manuscript and aided its devel- 
opment. Miss Lolafaye Coyne has had the 
principal load of the considerable statistical 
work and has contributed to its elucidation in 
this report. Mr. Kenneth Berg has shared some 
of the statistical work. My colleague, Dr. Robert 
Downing, has discussed aspects of the report 
with me. 

The work of the project has been generously 
supported initially by the Foundations' Fund 
for Research in Psychiatry and subsequently by 
the Ford Foundation. 
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balance between clinical and quantitative 
description. 

There is no need to go into the details 
of our aims, method, rationale (Waller- 
stein, Robbins, Sargent, & Luborsky, 1956; 
Luborsky, Fabian, Hall, Ticho & Ticho, 
1958; Sargent, Modlin, Faris, & Voth, 
1958), and operational problems of 
method (Hall & Wallerstein, I960; Wal- 
lerstein & Robbins, I960), for much has 
been published on these topics. The pres- 
ent report is the first in which we are able 
to give a portion of our results. 

Patients, Therapists, and Research Staff 

At this time (December, I960) we 
have completed assessments of 24 patients 
before treatment and at termination. Six- 
teen of these were again followed up and 
studied two years later. To go through 
our research procedures on this number 
of patients has required five years of work 
and waiting. We estimate another four 
years at least before all 42 patients have 
completed treatment and we have com- 
pleted the assessment on them at all three 
points. 

The patients were selected from among 
those assigned to psychotherapy and psy- 
choanalysis by the Menninger Clinic's 
Psychotherapy Service. Because of the 
problems of finding adequate cases in the 
clinical population, the selection is not 
completely random (Wallerstein & Rob- 
bins, I960, pp. 167-170). Only those 
cases who had been given a complete ex- 
amination by the Outpatient Service or 
the Hospital Service were included in the 
research. Of our total group of 42 pa- 
tients, half were to be in psychoanalysis 
and half in other forms of long-term 
psychotherapy. The 24 cases in this report 
approximately follow this proportion 
(11 were in psychoanalysis and 13 in 
other forms of psychotherapy). 

The therapists were those assigned to 
the patients by the regular Menninger 
Foundation procedures. Although certain 



criteria were applied for inclusion of the 
therapists in the project, the group is 
probably roughly representative of the 
therapists at the Menninger Foundation 
(Wallerstein & Robbins, I960, pp. 178- 
180), By usual standards the group of 
therapists would be considered experi- 
enced psychotherapists. 

A research team of two or three 
clinicians from the Psychotherapy Re- 
search Project was assigned to do the re- 
search assessment: Lewis Robbins and 
Robert Wallerstein assumed responsi- 
bility for the patient variables at the time 
of initial studies (and predictions about 
anticipated course and outcome of treat- 
ment); Bernard Hall, Lester Luborsky, 
Ernst Ticho, Gertrude Ticho, and Micha- 
lina Fabian have divided up the work on 
the patient variables and treatment vari- 
ables for both the termination and follow- 
up studies; for the situational variables. 
Harold Voth, Herbert Modlin, Helen 
Sargent, Mildred Faris, and Marjorie Orth 
have shared the work at initial, termina- 
tion, and follow-up points. 

Aims and Methods 

The general aim of the present report 
is to examine some patient variables 
which may be connected with change in 
patients in long-term treatment. In carry- 
ing out this aim, we will: 

(a) Examine the scores derived from 
the initial clinical assessments of the 
patient variables, in particular their re- 
liabilities, intercorrelations, and prin- 
cipal factors. Each of these patient 
variables had been chosen originally 
because of hypotheses relating them to 
the course and outcome of psycho- 
therapy. 

(b) Examine relationships between the 
patient variables and an estimate of 
change during treatment. At this stage 
of the project, the available measure of 
change is derived from the Health- 
Sickness Rating Scale (which is de- 
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scribed below under the heading of 
"Change in Health-Sickness Rating"). 
(c) Illustrate by (a) and (b) some of 
the problems of selecting estimates of 
change and describe our preferred 
methods for expressing change in pa- 
tient variables, to be used in the final 
analysis of the results. 
The worth of a judgment about a per- 
son rests partly on the quality of the in- 
formation from which the judgments are 
made. Before going into the specific 
methods of estimating the variables or 
change in the variables, we must say more 
about the observations. The collection and 
organization of the information in the 
various forms was the work of the three 
teams of clinician-researchers. For the de- 
scription of the patient, treatment, and 
life situation at "Initial," "Termination," 
and "Follow-up," the teams drew upon 
the views of a number of informants: the 
patient, therapist, supervisor of the 
therapy, psychological tester, the patient's 
relatives, and at times the patient's em- 
ployer. Thus we have a broad base of 
observation from which to derive judg- 
ments of the variables and changes in 
these. 

Three major ways of assessing our data 
are planned. One will be a clinical syn- 
thesis for each of 42 individual case his- 
tories. A second major approach will be 
the detailed categorization of predictions 
by a formal logical system, with the ex- 
amination of our line of reasoning for 
each individual confirmation or refuta- 
tion. The third major way will be the 
statistical handling of the data that derive 
from the paired comparisons (to be de- 
scribed below). It is from a portion of 
this last method that the material for this 
paper was drawn. 

PATIENT VARIABLES 
Choice of Variables 

As part of putting the project into its 
present shape, we distilled into 28 vari- 



ables the best clinical experience from 
psychoanalytic and other sources on pa- 
tients' qualities relevant to the course and 
outcome of treatment. These variables are 
defined and described elsewhere { Waller- 
stein, Robbins, Sargent, & Luborsky, 
1956). When the time came to apply our 
major quantitative method of paired com- 
parisons to these patient variables, we 
selected for the purpose only 12 variables. 
These were the ones which seemed most 
suitable for paired comparison judgments. 
"Somatization," for example, did not seem 
able to stand by itself as a variable, since 
most of our patients had little or none of 
it. Although we used only 12 of these 
variables in the paired comparisons, we 
continued to write our qualitative descrip- 
tions for every one of the original 28 
variables (that is, our Form B). 

The twelve variables are listed below 
(the numbers in parentheses refer to the 
concepts described on pp. 241-250 in the 
above reference) : 

1. Anxiety Level (H-l) 

2. Severity of Symptoms (II-2, 3) 

3. Self -Directed Aggression (II-4) 

4. Extent to which the Environment 
Suffers (II-5), (i.e., as a direct re- 
sult of the patient's illness) 

5. Externalization (IV-5) 

6. Psychosexual Development (III) 

7. Integration of Defenses (IV-2) 

8. Anxiety Tolerance (IV-3) 

9. Insight (IV-4) 

10. Ego Strength (IV-6) 

11. Motivation (VI) 

12. Quality of Interpersonal Relation- 
ships (VII) 

The Paired Comparisons Method of 
Judging Variables 

Our research requirements seemed best 
met by rank order statistics, specifically 
by an adaptation of the classical Fechner- 
ian method of paired comparisons by 
Sargent (1956). We were investigating 
the effects of many variables with a rela- 
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rively small number of patients (rather 
than a few well-defined variables on many 
patients). We needed a method that, by 
providing a quick examination of many 
variables, would help tell us which were 
worth the huge work of exact measure- 
ment. We made a beginning at such work 
in the construction of our instrument for 
assessing the Health-Sickness dimension. 
Ordinal scaling also has the advantage of 
assuming only that the individual is 
higher or lower on a scale; metric scaling 
requires measurable distances between 
points. Ordinal scaling refers more specif- 
ically to the relationships within the 
population. Finally, the preferred style of 
quantitative thinking by clinicians is most 
often in terms of a patient at hand having 
more or less of a quality than another 
patient. 2 

To pair every patient with every other 



2 To be precise, the paired comparisons 
technique eventuates in a scale that is more 
than ordinal but less than equal interval. To 
explain this further: if a judge could dearly 
differentiate all 12 patients in a batch and make 
consistent choices, Patient A would get 11 
choices, the next patient 10 choices, and so on 
down to the last one who would have zero 
choices. There would be no ties. However, the 
paired comparisons method allows for natural 
inconsistencies to appear (which the less time 
consuming ranking method would not); e.g., 
A is chosen over B, B over C, but C is chosen 
over A. Such inconsistencies may result in ties. 
(This may be thought of as low internal con- 
sistency or, more penetratingly, a reflection of 
the difficulty of distinguishing patients in a 
certain range.) Thus we will have more than 
an ordinal scale, since extreme differences in 
the patients will show in a stretch out of the 
distribution and small differences will show in 
bunching-up of the distribution of number of 
choices. We therefore learn something about 
which patients are closer to others and which 
further apart. We still cannot say, for example, 
that two patients who are five numbers apart 
in the low end of the scale are the same dis- 
tance apart as two patients who are five num- 
bers apart in the high end of the scale, but 
we do know more than that one patient is 
higher than the other. 



patient in a group the size of ours would 
be an impossibly difficult task. In Sargent's 
form of the paired comparisons procedure, 
the name of each patient was paired with 
every other in a batch of only 12 patients. 
The 42 cases had been broken down by 
random sorting into overlapping batches 
of 12 patients each. Each batch contained 
6 patients in psychoanalysis and 6 in other 
forms of psychotherapy; this rule of 
thumb division was intended to stretch 
the variety of patients in each batch. The 
clinician had only to decide for each pair 
"which of these two patients has more 
(of the variable) ?" The clinician was not 
expected to make a new assessment of the 
patient but rather to refer constantly to 
the forms compiled by the research team. 
The list of pairs was filled out independ- 
ently by two judges. So far, these judges 
have been members of the Psychotherapy 
Research Project. 

It will be of special interest to those 
who might use the paired comparisons 
method to know that clinicians find them- 
selves quite comfortable in making these 
choices, much more so than when they are 
asked for ratings of the variables. A prob- 
lem in this method appears when too 
many pairs are being judged at one sit- 
ting; the process becomes quite tedious. 

Interjudge Agreement 

To establish the comparability of 
batches, each patient appeared in two 
different ones. With our 42 cases, 7 over- 
lapping batches were composed. The 
seventh was formed by blending the last 
6 cases with the first 6 cases. Every batch 
was rated by two judges. Since 11 is the 
highest number of choices a patient can 
receive from each judge, and each patient 
appears in two batches, total scores range 
from 0-44. 

After completing the paired compari- 
sons for all patient variables at the initial 
point, we had to make some slight adjust- 
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ments for batch incomparabiiity. 3 Patients 
may have been chosen a different number 
of times because they were being com- 
pared with a different group of patients 
or because the judge's judgments began 
to drift away from his earlier standards. 

The agreement of the two judges who 
composed the research team at the initial 
point (LLR & RSW) was high. 4 What 
we have here is a form of "clinical relia- 
bility." Although the two judges did the 
paired comparisons without discussion of 
the position of the patient in the paired 
comparisons, they had worked closely to- 
gether in selecting and defining the vari- 
ables and had based their conclusions 
recorded in the forms on extensive dis- 
cussions of the case. Although these inter- 
judge consistency figures do not tell us 
what can be done by two judges working 
in complete isolation, they indicate the 
degree of agreement that two judges can 
achieve after sharing the digestion of the 

8 The choices on the six overlapping patients 
in successive batches can differ in two ways: 
in rank order and mean, number of choices. The 
first can be measured by a rank order correla- 
tion between the six patients on the two oc- 
casions; this type of incomparabiiity was not 
changed by our scaling corrections. The second 
was corrected for the group by the scaling 
technique all 12 variables went through one 
cycle of scaling in which the means for groups 
of overlapping cases on the total sample were 
equated by the addition or subtraction of a 
correction factor. (This does not mean that an 
individual patient will be corrected so that he 
has the same number of choices in both 
batches.) At this point the merger between the 
last batch and the first batch was tested. For 
7 of the 12 variables, this merger was not good 
enough (after the one cycle of corrections had 
already been made) so that a slight adjustment 
of previous corrections had to be made. 

4 Consistency of pooled judges was estimated 
in two ways: by correlating each judge's scores 
on each variable in each batch and by correlat- 
ing agreement of scores for each patient in suc- 
cessive batches of six patients. By both methods 
the median correlations over all batches for 
each variable were high all correlations were 
above .85. 



data and then making the paired com- 
parison judgments independently. 

Inter correlations 

The intercorrelations of the 14 vari- 
ables (that is, with the addition of "Pre- 
dicted HSR" and "Initial HSR") are 
generally high (see Table 1). The im- 
mediately obvious exceptions are "Anxiety 
Level" and "Self-Directed Aggression." 
We had expected considerable interrela- 
tionship since all variables were selected 
for their presumed bearing on the course 
and outcome of treatment. Possibly a halo 
effect contributes in part to the correla- 
tions; only more experience with these 
variables will tell us the extent to which 
this is applicable. However, it is impor- 
tant to note that even the highest correla- 
tions in this matrix do not imply com- 
pletely overlapping variables; for example, 
a correlation as high as 70 only accounts 
for approximately 50% of the variance. 

Factor Analysis 

In picking a group of variables it is 
hard to tell the extent of their overlap 
and composition without trying them. 
Factor analysis is an excellent method for 
finding the major groupings of variables 
(specifically the least number of factors 
which would explain the intercorrela- 
tions) and the components of each pa- 
tient variable (see Table 2). 5 By the 
Principal Components Method (Retelling, 
1933), the first factor will be the prin- 
cipal component. 

We had expected, from our preliminary 
intercorrektion study on the first 12 pa- 
tients (Luborsky & Sargent, 1956), that 
the first factor might also be the only 
factor, since the previous level of inter- 
correlation was even higher than the one 

5 To be precise, we did a components 
analysis which differs from factor analysis in 
that it finds the least number of factors (com- 
ponents) that can explain the total variance in 
all the variables. 
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reported here for 42 patients. Actually, nificant, while a loading of .30 or less is 
there was much meaningful variation left negligible) and minimize the lightest 
beyond the first factor in the unrotated loadings across a factor, 
matrix: the principal component still left We have tried to fit names to these fac- 
40 percent of the common variance un- tors and have listed them below, together 
explained. Factoring was considered com- w ith the variables having the largest load- 
pleted after five factors had been ex- ings (i.e., over .50): 
tracted, since by that point 90 percent of L Personality Development and 
the estimated common variance had been Strength (interpersonal relation- 
taken out. ships, psychosexual development, 
With the aim of finding simple struc- anxiety tolerance, ego strength, 
rure of the factors, they were rotated by predicted HSR, integration of de- 
the Normal Varimax Method (Kaiser, fenses, initial HSR). Note that the 
1958). This rotation method tends to variables in this largest factor tend 
maximize the heaviest loadings (with 42 to be more encompassing variables 
cases, a rough rule of thumb would be that referring to the patient's general 
any loading of approximately .40 is sig- level of functioning and resilience. 

TABLE 1 

INTERCORRELAHON OF PATIENT VARIABLES AT THE INITIAL POINT 
(Pearson Correlations, N=42) 

1 2 3 4 5 6 7 8 9 10 11 12 13 14 

1. Anxiety level x 

2. Severity of .60 x 
Symptoms 

3. Self-Directed .09 .45 x 
Aggression 

4. Extent to which .38 .75 .23 x 
environment suffers 

5. Externalization 34 .60 .10 .86 x 

6. Level of Psycho- -.16 -.56 -.24 -.44 -.44 x 
sexual Development 

7. Patterning of -.46 -.84 -.40 -.67 -.61 .72 x 
Defenses 

8. Anxiety Toler- -.03 -.53 -.14 -.59 -.59 .73 .72 x 
ance 

9. Insight -.23 -.38 -.29 -.36 -.46 30 .50 .49 x 

10. Ego strength -.41 -.77 -.21 -.68 -.63 .74 .93 .81 .49 x 

11. Motivation -.18 -.58 -34 -.63 -.67 j63 .69 .63 .67 .65 x 

12. Quality of Inter- -.10 -.62 -.20 -.56 -.52 .86 .80 .84 36 .86 .65 x 
personal Relationships 

13. Initial Health- -.46 -.84 -33 -.72 -.62 .64 .84 .69 .43 .81 .67 .72 x 
Sickness Hating 

14. Predicted -.11 -.62 -.41 -.57 -.48 .72 .69 .72 33 .68 .64 .78 .74 x 
Health-Sickness Rating 
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TABLE 2 

ROTATED FACTOR LOADINGS OF PATIENT VARIABLES AT THE INITIAL POINT 
(NORMALIZED VARIMAX) 





I 


II 


III 


IV 


V 


h 2 


1. Anxiety Level 


-.02 


.95 


.01 


-.09 


.15 


.94 


2. Severity of Symptoms 


-.50 


.58 


.37 


-.08 


.43 


.92 


3. Self -Directed Aggression 


-.12 


.06 


.96 


-.14 


.04 


.96 


4. Extent to which environment suffers 


-.35 


.26 


.13 


-.10 


.85 


.94 


5. Externalization 


-.30 


.17 


-.04 


-.28 


.35 


.92 


6. Level of Psychosexual Development 


.89 


-.08 


-.09 


.12 


-.09 


.83 


7. Patterning of Defenses 


.72 


-.44 


-.23 


.26 


-.29 


.91 


8. Anxiety Tolerance 


.82 


.06 


.04 


.29 


-.33 


.87 


9. Insight 


.19 


-.13 


-.13 


.93 


-.16 


.96 


10. Ego Strength 


.79 


-.38 


-.03 


.25 


-.31 


.92 


11. Motivation 


.50 


-.02 


-.22 


.58 


-.45 


.83 


12. Quality of Interpersonal Relationships 


.93 


-.05 


-.05 


.14 


-.22 


.93 


13. Initial Health-Sickness Hating 


.65 


-.41 


-.23 


.16 


-.42 


.84 


14. Predicted Health-Sickness Rating 


.77 


.01 


-.36 


.06 


-.32 


.82 


Percent of variance 


41.5 


14.9 


11.0 


12.7 


20.0 


90.0 



II. Anxiety Level (anxiety level, sever- 
ity of symptoms). 

III. Self - Directed Aggression (self- 
directed aggression). 

IV. Insight (insight, motivation). 

V. Externally focused illness (extent 
to which the environment suffers, 
externalization). 

These five are the essences remaining 
after the factor analytic boiling down. In 
evaluating a patient's potential for change 
in treatment, the two judges in our proj- 
ect relied especially upon the main factor, 
"Personality Development and Strength," 
together with the other four factors. 

METHODS FOR ESTIMATING CHANGE 

We had supposed that the variables 
probably in a unique combination for 
each patient would help in predicting 
the outcome of the treatment. To take the 
next step of actually relating these patient 
variables (and the factors) to change re- 
quires a tough decision about what to 
accept as an estimate of change. The most 



usual solution is to rely upon the thera- 
pist's rating of "improvement." This 
usually requires nothing more sophisti- 
cated than a four-to-eight point poorly 
defined scale; i.e., the judge is permitted 
to weight in his own way any aspects of 
change which he values in his concept of 
mental health. The rating cannot reveal 
either the point at which the patient 
started or the nature of the change. Used 
by itself, it is generally considered to be 
a crude and often misleading measure of 
change (MiUer, 1951; Sanford, 1953; 
Luborsky, 1954; Parloff, Kelman, & Frank, 
1954). 

Many refinements of improvement 
scales have been attempted (Lorr, 1954). 
A highly developed one is the "Hunt 
Movement Scale" (Hunt, 1950). The 
University of Chicago Counseling Center 
project tried, among other methods, a 
rating by the therapist of "success" (See- 
man, 1954) and a scale for "adjustment" 
as judged from the TAT (Dymond, 
1954). The recent Phipps Psychiatric 
Clinic study (Frank, 1959) relied upon 



well-defined criteria of improvement; they 
used differences before and after treat- 
ment in the patient's position on "dis- 
comfort" and "social ineffectiveness" 
scales. 

A different approach to investigating 
change is represented by Muench ( 1947 ) . 
He was one of the first to investigate the 
variety of changes in the patient (as op- 
posed to restricting attention to improve- 
ment in mental health) in his study of 
test score differences before and after 
treatment. An exacting method has been 
proposed for registering change on dimen- 
sions which are tailor-made for each indi- 
vidual (Luborsky, 1953): mtercorrelating 
intra-individual measurements taken from 
the therapy at intervals, factoring these 
and expressing change on these factors. If, 
for example, two symptoms fluctuate to- 
gether over time, we may suspect they 
spring from a similar dynamic source; 
change measures could then be in terms 
of the principal dynamic sources. In the 
last conference on psychotherapy Rogers 
(1959) described facets of the patient's 
experiencing of himself which could be 
scored from segments of the recorded 
psychotherapy. These were actually di- 
mensions of change which he then could 
relate to "improvement/* Other methods 
have been described by Miller (1951) 
and Zax and Klein ( I960) . 

Both approaches investigating the 
variety of changes and focusing on changes 
which are explicitly relevant to mental 
health are included in the Menninger 
Foundation Project. This distinction has 
been more fully explicated by Wallerstein 
(1959). For the present paper, we will 
report on one method of estimating 
change in mental health: "Change in 
Health-Sickness Rating." Another method, 
"Changes in Patient Variables," will be 
briefly delineated but not used until the 
final results of the project are available. 

Change in Health-Sickness Rating 

For more than a decade, a number of 
us at the Menninger Foundation have 



tried to perfect a shorthand quantitative 
survey instrument for estimating a pa- 
tient's mental health and the changes in 
it (Luborsky, 1962). In applying this 
method, the judge considers the patient 
in terms of seven criteria 6 and decides 
approximately where the patient would 
fall within a ranked standard series of 
sample patients; then he assigns the pa- 
tient a single rating from 0-100 as the 
Health-Sickness Rating (HSR). In no in- 
stance is the rater also the therapist. 

We currently have available HSR scores 
at the initial point (by the Initial Team) 
and the termination point (by the Ter- 
mination Team) for 24 patients and also 
at the follow-up point on 16 patients. 7 

The HSR is a special and limited seg- 
ment of our assessment; its seven criteria 
are all obviously value-laden they all 

6 The seven criteria in brief are: (1) ability 
to function autonomously, (2) seriousness of 
the symptoms, (3) degree of discomfort, (4) 
effect upon the environment, (5) utilization 
of abilities, (6) quality of interpersonal rela- 
tionships, and (7) breadth and depth of in- 
terests. 

7 The teams work separately. The Initial 
Team does not have access to later information 
about the patient. The Termination Team sees 
none of the Initial Team's quantitative scores 
but has access to the qualitative information. 
The members of the Termination Team record 
their HSR first without discussion of it with 
each other and then make a consensus rating. 
These separate HRS judgments tend to agree 
closely; e.g., the correlation of any two Ter- 
mination Team members with each other is 
.95 <N=22). 

As a further sample of the degree of agree- 
ment reached in the application of the scale: 
The Situational Variables team rated the HSR 
on the basis of their own discussions. They 
did their own evaluation and collection of data 
but had access to the information of the Initial 
and Termination Teams. Their consensus HSR 
ratings correlated .91 (N=24) with those of 
the Termination Team. 

An example of an application of the scale 
where complete independence was maintained 
is provided by Stone and Dellis (I960). HSR 
ratings based upon psychological tests showed 
considerable agreement between raters: from 
.69 based upon the Wechsler alone to .85 based 
upon the Rorschach alone. 
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share in the concept of mental health of 
the clinicians who developed the scale. 
Our full assessment, on the other hand, 
includes aspects of change with no clear 
relationship to mental health. Neverthe- 
less, most of the common variance can be 
explained by the first principal component 
which contains high loadings by the 
Initial HSR and Predicted HSR. These 
two variables are also moderately highly 
correlated with most of the other variables 
in Table 1. This confirms our hunch about 
the value of a generalized concept of 
health-sickness which runs through many 
of our variables. 

Change in the Patient Variables (as- Esti- 
mated by Paired Comparisons) 

When the paired comparisons at ter- 
mination and follow-up are complete on 
all 42 cases, we will have available our 
preferred method for estimating change. 
Although we now have 24 complete ter- 
mination studies, paired comparisons can- 
not be used until batch comparability has 
been judged, and this cannot be done 
without the complete group. We will do 
the same type of analysis on the variables 
as judged at termination as we report here 
for the initial patient variables. If the 
judges have a high reliability and the 
judgments have a similar factor structure, 
we may be able to extract vectors of 
change. We will have differences in the 
patient variables at initial, termination, 
and follow-up which are directly mean- 
ingful. We may have, for example, a 
scaled score based on paired comparison 
judgments for "Anxiety Level" which is 
directly comparable at the three points. 

INITIAL PATIENT VARIABLES 
AND CHANGE 

Of all the influences which are thought 
to determine the change a patient can 
make through treatment, the patient's per- 
sonality is most often thought to be pre- 
dominant. Here we will not look into the 
other influences, i.e., the treatment, thera- 
pist, or the life situation. Within the area 



of the patient variables, the most common 
hypothesis in the research literature (Lu- 
borsky, 1959) is that the greater the pa- 
tient's assets, the greater the benefit he 
will derive from treatment. Freud ( 1937) 
lists those principal factors which deter- 
mine how much change a patient can 
make: (a) the degree to which the illness 
is the result of a trauma ( the more purely 
traumatic, the more change can be made); 
(b) the strength of the instincts (the 
more excessive the instinctual demands, 
the more difficult it is to improve one's 
functioning); and (c) the degree of 
"modification of the ego" (the more dis- 
tortion of the ego, the more difficulty in 
obtaining a cure). The last of these is 
similar to the common hypothesis. The 
American Psychiatric Association nomen- 
clature includes this view in its well- 
known triad: "Prognosis" is a function of 
"premorbid personality" and "precipitat- 
ing stress" Illness is thus considered a 
reaction in which the better the premor- 
bid personally, the better the prognosis. 
Barron (1953) concludes on the basis of 
his MMPI Ego Strength Scale that those 
who are better off to begin with are likely 
to improve the most. Sullivan, Miller, and 
Smelser (1958) report similarly that pa- 
tients judged improved were more likely 
to be those with higher occupational 
achievements and less psychopathology 
(also based upon MMPI). 8 

8 Another apparently contradictory possibility 
is that the fewer the assets and the more severe 
the patients illness, the greater the gains he 
will make from psychotherapy. We found this 
trend in our 1952 survey of psychotherapy of 
the Department of Adult Psychiatry (Luborsky, 
1962). The HSR was applied by all therapists 
to their patients currently in psychotherapy at 
the Menninger Foundation. The amount of 
change in HSR depended upon the initial level 
of HSR: the lower the initial level, the greater 
the improvement. (However, in the 1952 
findings we were dealing with the difference 
between the initial HSR and the current point 
in treatment rather than the termination point) . 

These two hypotheses seem completely op- 
posed, but each contains the same two elements 
in reversed proportions: the first hypothesis 
refers to high capacity for change but little 
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INITIAL HEALTH-SICKNESS RATING 

Figure 1. Scattergram of Initial Health-Sickness Rating against Change in Health-Sickness 
Rating (Termination HSR minus Initial HSR) (N= 24; r=: -.18) . 



To see how this common hypothesis 
holds for our present patient sample, we 
will explore the "Initial HSR" in relation 

room for change (as the upper part of the 
scale of mental health is composed) ; the second 
hypothesis refers to low capacity for change 
with much room- for change. The second hy- 
pothesis may be partly a product of the familiar 
"ceiling effect": those who start with most 
dysfunction have most room for improvement 
and those who start with most assets have 
least room. But we do not mean to imply by 
the term "ceiling effect" that the relationship 
is entirely artifactual. Possibly those who are 
highest in HSR may be suffering less and be 
more self-satisfied and consequently less amen- 
able to change. However, these data alone will 
not permit a conclusion on the issue of arti- 
factuality. 



to change in the HSR during treatment. 
After that we can go into the relationship 
of the patient's position on each of the 12 
patient variables and change in HSR dur- 
ing treatment. 

Initial HSR vs. Change m HSR 

The common hypothesis does not apply 
if we consider only the negligible corre- 
lation with Change of -.18. However, a 
scattergram of these scores (Figure 1) is 
more informative than a correlation by 
itself. Considerable dispersion is revealed, 
but we do not see as random a dispersion 
as a correlation of .18 would imply. A 
longer look reveals a moderately curvili- 
near relationship. 
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We then can discern a grouping of 
cases that form a trend line corresponding 
to a "ceiling effect" (that is, the higher 
the Initial HSR, the lower the improve- 
ment and vice versa). This line, however, 
does not fit the data very closely. It is 
obscured by several cases with few assets 
who made little or no change. 

At the risk of overinterpreting slight 
trends in our search for hypotheses, we 
will take another look at the scattergram. 
It shows up the rudiments of the common 
trend reported in the literature. The pa- 
tients with more assets initially more 
often show a moderate positive change 
than those who start with fewer assets. 
We define "more assets" initially as "Ini- 
tial HSR of 50 or above." (In using HSR 
50 as a cutting point we are dividing 
patients along an important dimension. 
HSR 50 is defined as "definitely needs 
treatment to continue to work satisfac- 
torily and has increasing difficulty in 
maintaining self autonomously. . . ." In 
fact, 9 of the 10 patients in the "below 
50" group all actually HSR 38 and be- 
low were in the hospital at the start of 
their psychotherapy; none of the 14 at 
HSR 50 or above were in the hospital at 
any point during psychotherapy. Eight of 
the 9 who were in the hospital at the start 
of psychotherapy were able to leave the 
hospital and continue psychotherapy on 
an outpatient basis) . The dear gap on the 
scattergram between HSR 38 and 50 hap- 
pens to coincide with the cutting point 
we have selected. If we divide the change 
at +9 or above, the "more assets" group 
has 9 patients above this point and 5 
below. This certainly would not make a 
significant fourfold contingency table, but 
it shows the trend. The 10 patients with 
fewer assets initially (HSR below 50) 
seem to be more polarized: they either 
make little or no change, or they make a 
krge change. 9 

9 If we plot the Initial Rating assigned retro- 
spectively by the Termination Team and use 
the same cutting points, only one patient who 
started below HSR 43 improved more than +9. 



Averages of the amount of change in 
the "more" and "less" assets subgroups are 
not significantly different from each other. 
Neither from the results by this method 
nor from the results by the correktion 
method using the whole group is the com- 
mon hypothesis applicable. 

Klein's recent report (I960) on psy- 
choanalytic patients compares amount of 
change in patients with initial "moderate 
dysfunction" and those with initial "severe 
dysfunction/' The degree of dysfunction 
is derived from a rating scale based upon 
data of the "pretreatment history, admis- 
sions procedure, and the opening phase of 
treatment." It heavily stresses social func- 
tioning, self-esteem, symptoms, integra- 
tion, and insight. A five-point scale was 
used for categorizing the amount of 
change in these areas. Klein reports no 
significant difference between the two 
groups in the amount of change, although 
the difference slightly favored the "mod- 
erate dysfunction" group as she had ex- 
pected (that is, the common hypothesis). 
In her patient group, therefore, regardless 
of the level of dysfunction at which they 
began treatment, patients moved approxi- 
mately the same number of points, so that 
she raised the question of the limits of 
modifiability of patients. A similar find- 
ing is reported from the Chicago study 
(Seeman, 1954) : therapist's ratings of 
the client's initial status on "personality 
integration (vs. highly disorganized)" 
correlated only .08 with the therapist's 
rating of success of the treatment. The 
same lack of a significant relationship 
emerged for patient's estimates of a 
somewhat similar variable: ^-adjustment 
scores before therapy and change scores 
on the same measure correlated .25 
(Cartwright & Roth, 1957). 

In conclusion, three other psycho- 
therapy projects, as well as our own (for 
the group taken as a whole), came up 
with a negative result for the common 
hypothesis. The only suggestion for a pre- 
dictive trend came from the slight differ- 
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ences in the scatter within the group a 
person starting out above HSR 50 has a 
slightly greater chance of making a mod- 
erate gain than a person starting out be- 
low HSR 50. For the next steps, it might 
repay study to examine the patients in 
these subgroups even more carefully. Can 
one see, for example, differences in the 
"fewer assets" group between the five who 
improved and the five who remained 
essentially unchanged? Through inspec- 
tion alone of the patients in Figure 1, we 
note that the five in Quadrant I include 
all the patients with the most severe ad- 
dictive symptoms (IN, GD, BE, and even 
NY who is just across the dividing line) 
and the patient with the most severe 
paranoid symptoms (NO). Nothing as 
severe is to be found in the five patients 
of Quadrant II, or in fact, in any of the 
other patients in the entire group of 24. 

The brief analysis above points up an 
aspect of the scale that has to be taken 
into account: mental health is not a uni- 
form continuum. Therefore, changes 
which started at different points on the 
scale must have different meanings. A pa- 
tient who started at HSR 30 (WO) and 
lost her depression and became capable 
of functioning again, registered a huge 
change. But is this change the same as for 
a patient who started at 55 (CA) and 
was functioning fairly adequately except 
for her anxiety about caring for her child 
and being a proper mother for it? Resolu- 
tion of this patient's difficulties would not 
register a change as great as for the one 
who began at HSR 30. Are the changes 
in the two patients comparable? Similarly, 
10 points registered for NY, who started 
at 35, meant nothing significant for his 
functioning; the 3 points for BA, who 
started at 70, meant much more. This 
quality of the mental health continuum 
points up a major limitation in the global 
approach to the initial state of the patient 
as well as a limitation in the global ap- 
proach to "amount of change." In the 



analysis to follow, the defect of the global 
approach to the patient's initial state will 
be partially corrected. 10 

Initial Patient Variables vs. Change in 
HSR 

The 12 initial patient variables scores 
were each correlated with change in HSR. 
As anticipated, none of them individually 
had a high relationship with Change in 
HSR (see Table 3). 11 Only "Anxiety 
Level" had a significant relationship (.44). 

10 An afterthought led us to try an improve- 
ment rating for this present report. We were 
curious to see whether the usual type of im- 
provement score would correlate with our HSR 
change score. Two judges (BH & LL) made 
independent ratings of the 24 patients on a 
five-point crudely specified scale ranging from 
"no improvement" to "much improvement" 
However, these improvement ratings may still 
be only distant relatives of the usual improve- 
ment scores in the literature, for our improve- 
ment ratings were made by judges who knew 
the cases thoroughly and after the assessments 
were complete on all cases. Naturally, there- 
fore, the interjudge agreement was high 
(r=.88). 

The improvement ratings and the HSR 
change scores did not correlate very highly, 
however (r=.48). (The HSR ratings at the 
initial point were made by different raters than 
the HSR at termination. When we tried a 
change score in which the initial point was 
based upon the judgments of the same people 
who made the termination ratings [i.e., a 
"retrospective initial HSR rating"], the cor- 
relation with improvement was higher [.651). 

Initial HSR correlated .54 with the improve- 
ment ratings, while it correlated only .18 with 
HSR change scores! Possibly the relationship 
was influenced by the contamination of the 
judges making the improvement ratings by 
knowledge of the Initial HSR ratings. Even 
more likely, the judges gave more weight in 
their judgments of "improvement" to changes 
by patients who were in the top part of the 
HSR scale. 

11 A similar finding has been reported: 
none of a long list of patients' qualities as 
judged by diagnostic interviewers were cor- 
related significantly with amount of improve- 
ment (a type of Hunt Movement Score) as 
judged by therapists (Hunt, Ewing, LaForge, 
& Gilbert, 1959). 
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TABLE 3 

CORRELATIONS OF INITIAL PATIENT 
VARIABLE WITH CHANGE IN HEALTH- 
SICKNESS RATINGS 
N=24 



HSR Change Corrected 
HSR Change 
(Termination 
(Termina- HSR with 
tion minus Initial par- 
Initial HSR) tidied out) 



1. Anxiety Level 


.44* 


.37 


2. Severity of 


-.02 


-.16 


Symptoms 






3. Self-Directed 


-.08 


-.14 


Aggression 






4. Extent to which 


.04 


-.10 


Environment 






Suffers 






5. Externalization 


.01 


-.12 


6. Level of Psycho- 


.22 


.33 


sexual Develop- 






ment 






7. Patterning of 


.20 


.34 


Defenses 






8. Anxiety Toler- 


.05 


.18 


ance 






9. Insight 


-.09 


-.04 


10. Ego Strength 


.07 


.13 


11. Motivation 


.22 


.34 


12. Quality of Inter- 


.23 


.36 


personal Rela- 






tionships 






13. Initial Health- 


-.18 




Sickness Rating 






14. Predicted 


.13 


.26 


Health-Sickness 






Rating 






* Po ^ n*> 



We wondered whether a correction for 
the initial position of the patient would 
show more clearly the unalloyed relation- 
ships with Change in HSR. These correla- 
tions are presented in the same table; no 
dramatic alterations were produced by this 
type of correction. Although quality of 
interpersonal relationship, level of psycho- 
sexual development, and patterning of de- 
fenses got pulled up, they did not reach a 



significant level; but it is of interest that 
these are the ones which figured most 
highly in Factor I. 12 We constructed a 
scattergrani (Figure 2) of "Anxiety 
Level" against "Change in HSR" and 
found that the correlation does not ade- 
quately reflect the strength of the trend 
line. One patient, NO, who had the most 
psychotic coloring to her illness of any in 
the entire group, reduced the correlation 
markedly. 

The correlation of "Anxiety Level" with 
"Change in HSR" was unexpectedly 
higher than was true for the other vari- 
ables. Yet some relationship was not a 
complete surprise to us or to others. 
Rogers (1957) included among six con- 
ditions of therapeutic change, "the client 
is in a state of incongruence, being vul- 
nerable or anxious." Freud (1919) offered 
a rationale which clarifies this relation- 
ship. He believed an optimum level of 
"suffering" is conducive to change; pre- 
mature improvements can reduce the 
motive for change. The therapist's focus, 
therefore, should not be upon making life 
pleasant for the patient. The role of 
anxiety is especially clear in the treatment 
of patients with phobias. For cure to 
occur, Freud recommended that the pa- 
tient put up with the anxiety of engaging 
in the activities which arouse the phobic 
anxiety. This toleration of the anxiety 
gains for the patient an access to the 
relevant associations and memories which 
permit the phobia to be resolved. 

DISCUSSION AND CONCLUSIONS 

With our experimental design we were 
not out to prove hypotheses but to find 

13 We noted that most of the common vari- 
ance can be explained in terms of this first 
principal component. It is natural to wonder 
how a combined factor score (of Variables 6, 
7, 8, 10, 12, 13) would relate to the change 
measure. The correlation .36 does not quite 
reach .05 significance level (but is higher than 
the correlation of Initial HSR with the change 
measure). 
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hypotheses about the relationship of 
initial patient variables to change during 
psychotherapy. So far in this report we 
have examined two fragments of our data: 
(a) initial patient variables (assessed by 
the paired comparisons method) which 
we had expected to be related to change 
through psychotherapy and (b) correla- 
tions of these variables with an estimate 
of change. We will go on now to examine 
further the method for estimating change 
as well as to set forth some of the hypo- 
theses that appear most promising. 



We can conclude that: 

1. Helen Sargent's adaptation of the 
method of paired comparisons works ade- 
quately (although with some corrections 
necessary) in the estimation of the initial 
patient variables. 

2. Five principal factors appear to be 
the essential core of the initial evaluation 
of the patient, as a factor analysis of the 
intercorrelations of the scores on these 
patient variables brings out. These five 
factors reflect the main hypotheses of our 
judges on the dimensions which are most 
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relevant in estimating psychotherapeutic 
change. Of these five, the factor entitled 
"Personality Development and Strength" 
is the most heavily weighted. 

However, these factors are a represen- 
tative sample of our bases for estimating 
a patient's treatment outcome only if an 
adequate selection of the variables was 
put into the factor analytic machine. We 
also assume that the abstraction into vari- 
ables is a legitimate one; the actual process 
of estimating a patient's potential for 
psychotherapy may be better represented 
by the way we use specific items of infor- 
mation in making our predictions (Sar- 
gent & Horwitz, I960). 

3. The initial patient variables in gen- 
eral do not correlate highly with the meas- 
ure of change, Change in Health-Sickness 
Rating. The one exception, however, was 
the variable "Anxiety Level" which had a 
significant correlation with the change 
measure. We may, therefore, consider as 
a fair hypothesis that the higher the 
initial anxiety level, the greater amount 
of change a patient will make in psycho- 
therapy. Also, the "Initial HSR" which 
is a global estimate of the patient's initial 
position on the mental health dimension, 
does not relate highly to the change 
measure. 

It would seem reasonable at this point 
to conclude that the initial position of the 
patient on the health-sickness dimension 
or on a variety of personality variables has 
little to do with the amount of change he 
will make in psychotherapy. This would 
in fact correspond with our results as well 
as those of Klein (1959) and Katz, Lorr, 
and Rubinstein (1958). However, there 
are cogent reasons why we think the foun- 
dations of these relationships are shaky. 
These principal reasons involve principles 
that apply as well to much similar psycho- 
therapy research: 

1. There must be an interaction be- 
tween the initial position of the patient 
and the various therapeutic processes 



(and other influences) which intervene 
between the initial position and final esti- 
mates. We therefore never anticipated 
that change could be fully predicted from 
the initial patient variables in isolation; 
the treatment, therapist, and life situation 
also play a part. 

2. It is an important clinical assump- 
tion that the pattern of the initial patient 
variables is highly relevant. For this rea- 
son we stressed profile comparisons as 
the quantitative method which most close- 
ly fitted clinical assumptions (Luborsky & 
Sargent, 1956). We anticipated that 
single initial variables would only corre- 
late moderately with change for we were 
aware of relying upon various combina- 
tions of variables in our assessments. 

3. "Change in Health-Sickness Rating" 
is only one among several possible types 
of measures of change. Our results might 
have been different with other measures, 
for recent studies have shown that change 
measures sometimes do not correlate 
highly with each other (e.g., Rogers & 
Dymond, 1954; Gibson, Snyder, & Ray, 
1955; Cartwright & Roth, 1957). Cart- 
wright and Roth found that therapist and 
patient estimates of change fall into un- 
correlated factors; however, the separate 
therapist measures (plus lay observer and 
the TAT measures) hang together in one 
factor while the patient measures are to- 
gether in another factor. Further work 
with our HSR change measure will prob- 
ably place it nearer to therapist measures 
than to patient measures. 

4. For any measure of change in psy- 
chotherapy, one should be able to specify 
the beginning and ending point and the 
nature of the territory covered in the 
change. This is one of the values of the 
HSR method and a major deficit in the 
usual improvement rating. However, any 
scale should represent degrees of the same 
quality. Our change measure is probably 
not a unitary dimension but means differ- 
ent things at different parts of the scale. 
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5. The amount of change on the 
Health-Sickness Rating Scale may not 
take into account the personal meaning of 
certain changes. The changes may be 
small in terms of the mental health di- 
mension but quite significant to the per- 
son. This point has been made by Bren- 
man (1952) and by Schafer (1958). For 
example, after Termination, Patient CA 
was able to adopt a child and care for the 
child adequately, despite the expense of 
increased anxiety. The shift which made 
this change possible was of paramount 
importance to CA, but it may not be com- 
mensurately reflected in the Health- 
Sickness Rating (HSR at Termination, 
71; at Follow-up, 77). 

6. Changes from an initial to end of 
treatment point are not sufficient to indi- 
cate whether the changes are reasonably 
lasting. In future analyses changes also 
will be investigated from termination to 
the follow-up two years later. (From the 
16 patients who have reached Follow-up, 
we learn that gains are maintained with 
only a slight nonsignificant loss on the 
average from Termination to Follow-up 
with about half losing and half gaining 
slightly Mean Initial HSR, 48.0; Mean 
Termination HSR, 57.9; Mean Follow-up 
HSR, 56.9). A slight nonsignificant aver- 
age decrease from end of treatment to 
follow-up is also noted by Rogers and 
Dymond (1954). 

The analysis of the data of the Psycho- 
therapy Research Project is in its infancy; 
we are proceeding with the happy view 
that "the" best is yet to be. Eventually we 
will try other assessments of change: (a) 
clinical comparisons of the patients at the 
three points in time, (&) confirmation or 
refutation of predictions of change, and 
(c) comparison of changes in the profiles 
of paired comparison scores at the three 
points. The last will provide a more con- 
figurational measure which should relate 
more directly to the interactions among 
the three sets of variables. Thus the efforts 



in the present report to rekte an initial 
position on single variables to a single 
measure of change are but tentative be- 
ginnings of a larger effort to study inter- 
actions among configurations of three sets 
of variables that change over time. 

All these principles represent "promis- 
sory notes" for analyses which we will 
eventually report. To keep up the market 
value of these notes we will show how 
some of these can be applied to the refine- 
ment of the hypotheses we have formu- 
lated. 

Refinement of the (t Anxiety Level" 
Hypothesis 

The Anxiety Level Hypothesis was 
based upon the entire range of the HSR. 
However, if HSR is not a unitary dimen- 
sion, relationships may not hold over the 
entire range. If we divide the HSR scale 
at its midpoint, we find that the change 
for patients who start below HSR 50 
(fiF=10) covers an almost totally different 
area of the scale than the group who start 
at HSR 50 and above (=14). Only four 
patients in the low group overlap at all, 
and the overlap is very slight. We there- 
fore suspected what emerged: the correla- 
tion with Anxiety Level differed for each 
subgroup (r for the total group=.44; for 
the high HSR group alone==66; low 
group alone=.ll). A more refined state- 
ment of the hypothesis might be: For the 
patients who start treatment with at least 
a moderately high capacity for autono- 
mous functioning, etc., the higher the 
level of anxiety the greater the change 
that is likely?* 



13 After completing the present report, it 
was a pleasure to read the similar formulation 
of my colleagues Siegal and Rosen (1961) 
who independently concluded from the psy- 
chological tests that the significance of anxiety 
varies in different patients; crucial for thera- 
peutic change is the "capacity to experience 
anxiety as a signal that further ego activity is 
required." 
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Refinement of Hypothesis about the 
Initial Level of Mental Health 

We noted earlier that the Initial HSR 
(and most Initial Patient variables) did 
not correkte significantly with Change in 
HSR. Nevertheless, we saw that greater 
relationships may exist for certain seg- 
ments of the HSR scale. It might also be 
that the amount of change is less predict- 
able than the end point of the change. 

When we examined the predictions by 
the two Initial judges of the end state 
(i.e., Termination HSR) we found they 
seemed to be operating on the hypothesis 
that the best estimate of the end state was 
the Initial state plus a moderate incre- 
ment their Initial HSR correkted .73 



4U 
25 
20 
15 
10 
5 
n 






^f""' 








/ 


PREDICTE 
CHANGE 


D\ 
\ 






/ 
/ 


/ 


\ \ 


e . 




- - ' 


'ACTUAL 


CHAN\E 










\ 

















25- 

34 



35- 
44 



45- 
54 



55- 



65- 

74 



INITIAL HSR 



Figure 3. Initial HSR against amount of 
predicted and actual change in HSR (N= 24) . 

with their Predicted HSR. Their predic- 
tions actually turned out to be fairly ac- 
curate; i.e., their Initial HSR correlated 
.71 with the Termination HSR! And, in 
fact, two of the three worst predictive 
errors seemed due to neglecting their own 
hypothesis they predicted huge changes 
for two patients who started out quite low 
in HSR. The increment of change was less 
predictable than the end level (the corre- 



lation of the increment predicted and the 
actual increment is .40). This may seem 
paradoxical at first glance. However, it is 
easily resolved: the judges were not able 
to predict amount of change accurately, 
but whatever increment they added did 
not change the patient's position on the 
HSR scale in relation to the other patients 
(hence the high correlation between 
Initial HSR and Termination HSR). 
Finally, we should recognize in this find- 
ing the probable reason for the major 
factor "Personality Development and 
Strength": the judges were working we 
see now, correctly on the hypothesis that 
a correct assessment of the present level 
of mental health gives the best estimate 
of the future level. 1 * 

14 The judges of the Initial study team held 
out hopes of positive change for every one of 
the 24 patients; for only two of the patients 
did they predict less change than occurred. The 
predicted increment was not constant at all 
points on the scale: the relationship was clearly 
curvilinear between the Initial HSR and the 
amount of change predicted. Those who were 
initially low in HSR were given low predictions 
of change, those in the middle range of HSR 
were given the highest prediction of change, 
and those in the top range of HSR were given 
moderate to low predictions of change. This 
somewhat bell-shaped curve actually holds 
between Initial HSR and actual amount of 
change! (See Figure 3.) 
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Relation of Treatment Frequency and 
Duration to Psychotherapeutic Outcome 

MAURICE LOBR, PH.D. 



Investigation of the relation of thera- 
peutic outcome to frequency and duration 
of psychotherapy is analogous in many 
ways to the study of drug dosage and its 
effects. For a given drug it is possible to 
vary the size of the dose, the number of 
administrations, the frequency of adminis- 
tration, and the duration of a course of 
treatment. Psychotherapeutic outcome 
may be studied similarly, in relation to 
duration of a single interview, number of 
interviews in a course of treatment, fre- 
quency of treatments per week or month, 
and duration of a course of treatment. 
Yet it is surprising how rarely therapeutic 
gain has been investigated in relation to 
these potentially influential variables. 
Their prescription by the therapist or the 
clinic appears to be based on clinical ex- 
perience and tradition, although social 
dass status also plays an important un- 
recognized role. Other considerations that 
limit contacts are therapist time and the 
income of the patient. 

Current practice in public clinics is to 
schedule most psychiatric patients for in- 
dividual psychotherapy once or twice a 
week for about 50 minutes on each occa- 
sion (Feldman, Lorr, & Russell, 1958; 
Hollingshead & Redlich, 1958). Patients 
seen for psychotherapy in private practice 
are likely to be scheduled at similar rates. 
However, the length of a patient's thera- 
peutic interview is related to his social 
dass position (Hollingshead & Redlich, 
1958). Lower class patients are usually 
seen for 15 to 30 minutes, while upper 
class patients are rarely seen for less than 
50 to 60 minutes. The number of visits 
per week made by patients receiving in- 



dividual psychotherapy from private prac- 
titioners is definitely correlated with dass 
status. The higher the class the more fre- 
quently the treatment is administered. In 
veterans clinics (Feldman et al., 1958) 
education, a crude index of class status, is 
similarly correlated with the scheduled 
number of visits. The length of time a 
patient remains in treatment is linked to 
social class although the patient's diag- 
nosis and the goals of psychotherapy seem 
equally important determinants. 

The most widely held view appears to 
be that therapeutic progress in individual 
psychotherapy that is directed at reorient- 
ing or changing the person will be a posi- 
tive function of the intensity and fre- 
quency of contacts. Clara Thompson 
(1950) and others have argued that dura- 
tion of treatment rather than frequency 
of contact is the crucial factor in such 
treatment. The purpose of this paper is to 
critically review some of the studies avail- 
able that seek to relate frequency of con- 
tact and duration to therapeutic change. 
Studies concerned with the relation of the 
number of treatments to improvement 
will be described first. Then, a digest of 
a recently completed study of the influ- 
ence of treatment frequency and duration 
on treatment outcome will be presented. 

Seeman (1954) reported a study of 
counselor judgments of therapeutic out- 
come in relation to case length for 23 
clients who received nondirective counsel- 
ing. He reports a trend in favor of higher 
success ratings for longer cases. The 
shorter cases spanned the entire range of 
success ratings from 1 to 9, while the 
longer cases were judged to fall on two 
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high points of the scale (7 and 8). He 
concludes that if a client is in therapy for 
at least 20 interviews, there is a strong 
assurance, as judged by the counselor, of 
gain in therapy. Since Seeman fails to pro- 
vide any statistical data it is not possible 
to judge the validity of his findings. 

Myers and Auld (1955) examined the 
records of 23 cases that came to a com- 
munity clinic over a one-year period. All 
were seen by senior staff and resident 
psychiatrists for "expressive" psycho- 
therapy. The manner in which therapy 
was terminated was classified as follows: 
the patient simply quit; was discharged as 
unimproved; was terminated as improved; 
was continued on treatment elsewhere. 
The data show that discharge status of 
unimproved does not vary with number 
of interviews. However, of 16 patients 
discharged as improved, there were zero 
with 1-9 treatments, seven with 10-19 
treatments, and nine with 20 or more 
treatments. This suggests that a minimum 
number of treatments are required for a 
rating of improvement by a therapist. It 
should be noted that duration of treat- 
ment, which is not reported, may be con- 
founded with number of interviews. 

Imber et al. (1957) were concerned 
with the relation between amount of con- 
tact between patient and psychotherapist 
and improvement rate. They hypothesized 
that patients having fewer and briefer 
sessions of psychotherapy would show 
significantly less improvement than pa- 
tients with more and longer sessions over 
the same period of time. Fifty-four psychi- 
atric patients were assigned at random to 
three psychiatrists, each of whom treated 
equal numbers of patients in group psy- 
chotherapy and in two forms of individual 
psychotherapy. The group psychotherapy 
patients were seen once a week for about 
one and one-half hours. The analytically 
oriented individual therapy patients were 
seen once a week for an hour. The mini- 
mal contact therapy patients were seen 



individually for no more than half an 
hour once every two weeks. The average 
number of sessions was 17.7 for those 
patients in analytic-type individual treat- 
ment, 15.8 for the group therapy patients, 
and 93 for the minimal contact patients. 
Patients in the three groups were re- 
evaluated six months after treatment com- 
menced. An analysis of covariance of in- 
effectiveness scores showed that group 
therapy patients improved more than 
minimal contact patients but not more 
than the analytically oriented individual 
therapy patients. The ktter group also im- 
proved more than the minimal contact 
group. The authors conclude that their 
hypothesis had been confirmed. 

Unfortunately, length of interview, fre- 
quency of treatment, and type of treat- 
ment are confounded in the study design. 
Thus, despite the study's many merits, it 
is simply not possible to infer which vari- 
able was the effective agent. Minimal con- 
tact patients received a treatment that was 
different from that received by the other 
two groups. Single therapeutic sessions 
for the three groups varied from 30 to 
90 minutes in length and thus are con- 
founded with the number of treatments 
received over the six-month period. The 
effective condition that separated the re- 
stricted therapeutic contact group from 
the other two groups could have been 
fewer sessions, briefer sessions, or type of 
treatment. 

Ends and Page (1959) have reported 
a study aimed at testing the usefulness of 
group psychotherapy with alcoholic pa- 
tients, and the intensity of its application. 
More specifically, they asked whether 
doubling the number of group therapeu- 
tic sessions from 15 to 30 within the same 
time interval would result in significantly 
greater therapeutic movement. They con- 
dude that doubling the number of ses- 
sions without increasing the total elapsed 
time in treatment results in significantly 
greater therapeutic movement. However, 
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the 15 and 30 interview groups were not 
run in the same study. The data on the 15 
interview group were collected in an 
earlier phase of the project, and the results 
with this group were known before the 
30 interview group was studied. Further, 
the two groups were from obviously dif- 
ferent populations on such variables as 
age, duration of drinking, and initial 
scores on the study criteria. No effort to 
statistically control these differences was 
attempted. Finally the fact that the 15 in- 
terview group showed even fewer changes 
than a control group run simultaneously 
with the 30 interview group is even 
stronger evidence of the population differ- 
ence. Thus, the conclusions of this study 
regarding treatment frequency are ex- 
tremely doubtful. 

Cartwright (1955) studied counselor 
ratings of success in client-centered psy- 
chotherapy in relation to length of 
therapy. The total sample of closed cases 
was analyzed into two groups: one group 
of short-case clients (1-12 interviews) 
and the other of long-case clients (13-77 
interviews). Within each group there was 
a strong positive relation between number 
of interviews and success rating. A "fail- 
ure zone" between the 13th and 21st in- 
terview was interpreted as a period during 
which potentially long-case clients drop- 
ped out of therapy. Taylor (1955) came 
to a similar conclusion from a study of 
309 closed cases from a psychoanalytically 
oriented clinic Thus, rated improvement 
appears to be positively related to the 
number of treatments within each type of 
group. 

The most recent report encountered is 
one by Nichols and Beck (I960). They 
were concerned with personality change 
in 75 undergraduates who received psy- 
chotherapy in a psychological clinic. The 
therapists were 14 third and fourth year 
graduate students. Clients were seen for 
an average of 14.7 interviews, and no stu- 
dent was seen for less than 5 interviews. 



The authors factored 30 change scores ob- 
tained from 18 California Psychological 
Inventory measures, 4 Sentence Comple- 
tion measures, 4 client ratings, and 4 
therapist ratings. Six factors were found. 
Only Factor B, which is defined by thera- 
pist ratings of change in symptoms and 
complaints, understanding of self, feeling 
toward life (happiness), and over-all im- 
provement, correlated with the number of 
interviews received. This correlation is .29 
(one-tailed test). Thus, only therapist 
judgment of improvement, which could 
be biased under the conditions of ratings, 
is associated with number of treatments. 
Further, as Nichols and Beck (I960) in- 
dicate, the correlation is also confounded 
with time between tests and with placebo 
effect. The net results provide little to 
support the notion that increasing the 
number of contacts will improve the pa- 
tient proportionally. 

Treatment Frequency and Change 

The last study to be described (Lorr, 
McNair, Michaux, & Raskin, 1962) aimed 
to test the broad hypothesis that therapeu- 
tic gains resulting from individual psycho- 
therapy increase with the number of 
treatment interviews received over fixed 
time intervals. The following were the 
specific hypotheses: the greater the num- 
ber of psychotherapeutic interviews the 
greater (a) the reduction in manifest 
anxiety; (b) the reduction in the number 
and severity of patient complaints and 
problems; (c) the increase in ego 
strength; (d) the increase in self -accept- 
ance; (e) the increase in sociability; (/) 
the reduction in hostility towards others; 
(g) the increase in independent behavior; 
(>&) the number of positive behavioral 
changes reported by the therapist; (i) the 
level of self -awareness. 

The study design called for the ran- 
dom assignment of patients, at each of 
seven mental hygiene dinics, to one of 
three different treatment schedules twice 
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weekly, once weekly, and once biweekly. 
Each patient selected for the study was 
interviewed and tested just before initia- 
tion of treatment and again at the end of 
16 weeks and 32 weeks of psychotherapy. 
The sample in each clinic was confined to 
male veterans with service-connected dis- 
abilities, less than 51 years of age, and 
without any current indication of brain 
injury. None had received psychotherapy 
within the 90 days prior to inclusion in 
the study. The typical patient, of the 133 
included, was 37 years of age. Approxi- 
mately half were high school or college 
graduates, and of the 75 percent em- 
ployed, the average annual earnings were 
$3500. 

Seventy-five different therapists partici- 
pated in the study. Of these, 64 were staff 
members and 11 were residents or train- 
ees. There were approximately equal 
numbers of psychiatrists, social workers, 
and clinical psychologists. The typical 
therapist had four and one-half years of 
experience as a psychotherapist. The 
treatment, called "intensive," consisted of 
interviews 5060 minutes in duration and 
directed toward changing the patient, 
assisting him to modify his personal ad- 
justment patterns, and aiding him to make 
more constructive use of his assets. Most 
therapists were psychoanalytic in orienta- 
tion, although Sullivanian and modified 
Rogerian approaches were represented. 

The Criteria 

Since the various measures are de- 
scribed fully in the monograph, they will 
only be listed here. Ten patient criteria 
were used to evaluate the changes hypo- 
thesized. Included were the following: 
(a) Manifest Anxiety Scale; (b) Symp- 
tom Check List (20 items); (c) Ego 
Strength Scale (Barron); (d) Sociability 
Scale; (e) Friendliness Scale; (/) Self- 
Rating Scale (16 five-point scales); (g) 
The Interpersonal Check List (ICL). The 
ICL provided measures of assertiveness, 
cooperativeness, hostility, and dependence. 



The therapist rated his patient on 
Severity of Illness which was derived from 
ratings on seven four-point scales. He also 
described his patient on the ICL. A 
Change Inventory was completed by the 
therapist at the time of each re-evaluation. 
The Inventory consisted of 92 statements, 
marked true or not true, which are de- 
scriptive of specific changes frequently 
observed in patients. Included was a score 
on Interview Relationship (IR), a score 
on Interpersonal Changes (1C), and a 
third measure of Symptom Reduction 
(SR). The social worker interviewed the 
patient at the time of intake and at the 
close of 16 weeks of treatment. He rated 
the patient on a number of scales, but 
only ratings on social adjustment and 
severity of illness were used in the 
analysis. 

The statistical model for evaluating the 
effect of increasing amounts of psycho- 
therapy on the various criteria was analy- 
sis of covariance within a simple random- 
ized design. Final criterion mean scores 
were adjusted for initial status on the 
criterion being analyzed. In each instance 
the correlations between initial criterion 
scores and various predictor and back- 
ground variables were examined for pos- 
sible statistical control. The control vari- 
ables considered included schooling, earn- 
ings, employment status, vocabulary, and 
similar characteristics of the patient. 
Other variables inspected were length of 
experience and rated competence of the 
therapist as well as his liking for the 
patient. 

The Four-Month Results 

During the first 16 weeks of therapy 
the twice- weekly frequency group actually 
attended an average of 25.5 therapy ses- 
sions; the once-weekly group, an average 
of 14.5 sessions; and the biweekly group, 
an average of 8.6 interviews. The three 
treatment groups did not differ signifi- 
cantly when treatment began on any of 
the criteria or on predictor or background 
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variables. Nevertheless, the influence of 
initial scores on the four-month scores was 
statistically eliminated except for the 
Therapist Change Inventories. 

None of the F tests on the six patient 
criteria, the five therapist criteria, or the 
two social work criteria were significant 
at the .05 level. Patient, therapist, and 
social worker concurred in observing no 
differences ascribable to treatment fre- 
quency. Thus the major hypothesis re- 
ceived no support for the patients studied 
over a 16-week interval. A check on a 
possible differential dropout rate by treat- 
ment frequency was negative. In order to 
test for treatment gains, all treatment 
groups were pooled and tests were made 
on the combined group scores. There were 
no significant changes on the patient 
measures over the first four-month period. 
However, both therapists and social work- 
ers independently observed a significant 
decrease in severity of illness of the study 
sample. There was also significantly 
greater congruence between therapist and 
patient in their ICL descriptions of the 
patient. 

The Eight-Month Results 

The eight-month analysis was based on 
58 patients who remained in the study on 
the original randomly assigned treatment 
frequency schedules. There were 16 pa- 
tients in the twice-weekly group with an 
average of 50.8 therapy sessions. Thirty 
patients in the once-weekly group had an 
average of 27.7 sessions, and 12 patients 
in the biweekly group had an average of 
14.4 hours of treatment. The groups did 
not differ significantly on initial crite- 
rion, predictor, or background variables. 
The relation between treatment frequency 
and remaining or terminating was not 
significant. However, the pretreatment 
status of patients remaining in the study 
for 32 weeks at assigned treatment sched- 
ules differed significantly in certain re- 



spects from patients who did not. The 
eight-month sample had higher Manifest 
Anxiety scores and less favorable self- 
descriptions. Their therapists observed 
significantly less 1C + SR change during 
the first four months of therapy than for 
the dropout group. 

Analysis of 15 criteria of response to 
psychotherapy indicated that none of the 
differences between treatment frequency 
groups were significant at the ,05 level. 
Thus, once more the research hypothesis 
that treatment effects will be greater with 
more frequent treatments was not sup- 
ported after 32 weeks of psychotherapy. 
Patient and therapist agree on this finding. 
The treatment groups were next combined 
and tests were made to identify any gains 
from initial status to eight-month status. 
Of the patient measures, the Ego Strength 
Scale scores increased significantly in the 
expected direction. Patients also used 
fewer dependency adjectives in describing 
themselves on the ICL. The therapists re- 
ported a significant decrease in severity of 
illness and noted significantly more symp- 
tom and interpersonal changes at eight 
months than at four months. 

One-Year Follow-Up 

One year after beginning psycho- 
therapy, all of the patients who had com- 
pleted at least four months of psycho- 
therapy were asked to submit to a follow- 
up re-evaluation. Of 102 patients retested, 
55 had remained in psychotherapy for the 
entire year (In Group) and 47 had com- 
pleted or terminated psychotherapy some 
time after four months of treatment (Out 
Group). The 31 patients who did not re- 
spond to the follow-up request did not 
differ significantly in background char- 
acteristics from those retested. 

Both the In Group and the Out Group 
were dichotomized into two groups on the 
basis of the number of interviews re- 
ceived. Patients receiving less than the 
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median number of interviews were classed 
as Lows; all others were classed as Highs. 

In Group Comparisons 

The High In Group consisted of 28 
patients seen an average of 62 interviews. 
The Low In Group consisted of 27 pa- 
tients seen an average of 27 interviews. 
Tests showed that the High and Low 
Groups differed significantly on some 
background variables. The High Group 
was younger, more frequently unemployed 
and single, and reported fewer symptoms. 
Tests for differences between the two 
groups at one year (initial scores con- 
trolled) showed that the High Group 
scored significantly lower on Cooperative- 
ness and Friendliness. None of the thera- 
pist measures discriminated between the 
two groups. An item analysis showed that 
reduced "Friendliness" means less fre- 
quent endorsement of such platitudes as 
"It pays to turn the other cheek rather 
than to fight," and more frequent endorse- 
ment of such statements as "It is often 
necessary to fight for what is right," and 
"If I resent someone's action I promptly 
tell him so." The reduced "Cooperative- 
ness" scores were due to less frequent 
endorsement of such self-descriptions as 
"Accepts advice readily," "Kind and re- 
assuring," and "Often helped by others." 
Thus the High Group became more out- 
spoken, independent, and determined to 
protect its own interest. 

Significant changes from pretreatment 
status occurred on three of the patient 
measures for the In Group. Manifest 
Anxiety score and number of symptoms 
decreased while Ego Strength scores in- 
creased. Therapists report a significant 
decrease in severity of illness, more inter- 
personal changes, and more symptom re- 
ductions compared with changes during 
the first four months of psychotherapy. 
Thus patients in treatment status at the 
close of one year show a pattern of change 



that is broader than 
months. 



at four or eight 



Out Group Comparisons 

The High Interview Out Group con- 
sisted of 23 patients who had been seen 
an average of 34 interviews. The Low 
Out Group consisted of 24 patients seen 
an average of 16 sessions. There was no 
difference between High and Low Groups 
in actual duration of treatment. The mean 
length of therapy was 29 weeks for both 
groups. The High Group differed from 
the Low Group only on Severity of Illness 
on initial scores and background variables. 
The covariance analysis of the differences 
between High and Low Out Group at the 
end of one year showed up three signifi- 
cant differences. As with the In Group, 
the High Out Group was lower on Friend- 
liness and Cooperativeness. In addition, 
the High Out Group patients showed a 
significantly greater reduction in number 
of dependency adjectives used in self- 
descriptions. These findings tend to con- 
firm the finding that patients with more 
interviews see themselves as more asser- 
tive and outspoken in pursuing their own 
interests, less dependent, and less willing 
to be imposed upon by others. 

To determine whether these were sig- 
nificant shifts made by the entire group 
from pretreatment status, tests were made 
on variables unrelated to number of treat- 
ments. None of the differences were sig- 
nificant. Thus among the Out Group, only 
those patients with an above median num- 
ber of interviews present evidence of 
change from pretreatment status. 

Thus, for patients remaining In treat- 
ment for as long as eight months, there is 
little evidence from the study just cited 
that the number of times the patient is 
seen effects the outcome. Duration of 
therapy, rather than treatment frequency, 
is associated with change over an eight- 
month period. For the one-year period the 
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basis of treatment effects is uncertain be- 
cause comparisons are no longer based on 
groups to which patients have been ran- 
domly assigned and maintained under set 
treatment conditions. On the other hand, 
the agreement as to the kinds of changes 
exhibited by the High In Group and the 
High Out Group suggests that the num- 
ber of treatments does have some influ- 
ence on outcome after a one-year period. 
Of the two factors, duration of psycho- 
therapy appears more influential than 
treatment frequency. The patterns of 
change become broader and more con- 
sistent at each assessment period. 

The Cam/right (1955) and Taylor 
( 1956) finding that the number of treat- 
ments clients receive is related (non- 
linearly) to therapist's ratings of im- 
provement receives only partial support 
in the treatment frequency study (Lorr 
et al., 1961). Data on patients out of 
treatment at the end of one year suggest 
that a minimum number of treatments are 
required to effect an assessable change. 
The Low Out Group did not change after 
an average of 16 interviews, while the 
High Out Group did after 34 sessions. 
However, neither the Cartwright nor the 
Taylor study appears to have controlled 
duration of treatment. Neither author 
provides data concerning the number of 
weeks their patients remained in treat- 
ment nor their treatment schedules. A 
patient wtih 14 treatments at the time of 
termination could have been treated for 
seven weeks on a twice-a-week schedule, 
or for 14 weeks on a once-a-week schedule. 

Clara Thompson's comments in her 
Psychoanalysis (1950) have a bearing 
here. She says: 

Originally it was thought that six times a 
week was essential in order thoroughly to 
immerse the patient in the contemplation of 
his problems .... When analysis developed 
in the United States, I suspect the tendency to 
take long week ends contributed to the decision 
that analysis could be done five times a week. 
But whatever motive brought the change 



about, the change itself demonstrated that five 
times a week still produced effective analysis. 
The recent war with its great shortage of psy- 
choanalysts, coupled with an increased demand 
for treatment, has encouraged further experi- 
mentation, and it has been found that effective 
psychoanalysis can be done in many cases on a 
three-times-a-week basis in very rare cases 
even on a once-a-week basis .... The three- 
times-a-week experiment is responsible for 
another discovery. In actual duration of treat- 
ment, in terms of months and years, the patient 
going five times a week takes about as long to 
be cured as the patient going three rimes. 

Change would appear to require the 
passage of time. Insights are put into 
practice in daily living. New ways of 
reacting interpersonally must be tested 
again and again in natural settings before 
what has been learned becomes consoli- 
dated. Trial and error testing seems a 
prerequisite for the process of growth and 
change. Especially in adults, there is no 
reason for expecting striking charactero- 
logical changes in the matter of weeks. 

In conclusion, the review of studies 
available suggests that duration of treat- 
ment is a more influential parameter than 
sheer number of treatments. It would 
appear that traditional treatment fre- 
quency schedules should be examined 
more critically. Therapist time can be 
spread over more patients with fewer con- 
tacts and at less cost to patients. 
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Toward What Level of Abstraction in Criteria? 1 
JOHN M. SHUEN, PH.D. 



The problem under main consideration 
here is that of the level of abstraction to 
which a concept in personality measure- 
ment may be raised, or should be raised, 
and the ways in which different levels of 
abstraction gain or lose in value for the 
researcher, according to his aims. This 
problem is one of many which developed 
in a practical research setting. That setting 
will be briefly described to give the con- 
text and history of this single instance of 
research, which in turn is presented as a 
particular illustration of the general prob- 
lem: at what level of abstraction shall 
personality change be measured? 

The context is one of outcome evalua- 
tion and comparison. Despite increasing 
and eminently worthwhile studies of 
process, there is serious doubt as to 
whether outcome studies are really behind 
us. Especially there is still much work to 
be done in the comparisons between out- 
comes produced by different forms of 
therapy. One can see evidence of growing 
inclinations among therapists of divergent 
schools of thought to put their work to 
test against not only controls, but each 
other, and this not in a hindering com- 
petitive spirit, but out of a cooperative 
and venturesome interest. We can expect 
more of such studies in the next decade, 
and obviously these will require a set of 
measurements with at least some common 
application in every experiment. One 
might hope that a conference such as this 
one would eventually produce a core bat- 
tery of change measures, and stimulate 
the comparative research of which such a 
group of conferees would be capable. 

1 Prepared with the aid of a grant from the 
Ford Foundation (Psychotherapy Research 
Project) to the Counseling Center, University 
of Chicago. 



SECONDARY PROBLEM IN CONTEXT 

The study of psychotherapy which pro- 
vides the background for this problem is 
one in which comparisons were made, 
first between two different kinds of struc- 
ture within the same orientation. That 
orientation was client-centered, and the 
structures were those of (a) an unlimited 
number of interviews, with voluntary ter- 
mination, compared with (b) time- 
limited therapy in which the number of 
interviews was limited to 20, with ter- 
mination set in advance (Shlien, 1957). 
In a second study, the same structure of 
time limits was compared in two different 
types of therapy, client-centered and Ad- 
lerian. For the moment, the history of the 
first study is a significant one. There, the 
main focus was a test of the value of time- 
limits in therapy of their effectiveness 
as compared with controls, and of their 
efficiency when compared with longer un- 
limited cases. 2 The results were almost 
unanimously confirming of effective and 
efficient outcomes for time-limited ther- 
apy: six of the seven criteria used were 
in agreement on this point (Shlien, 1956). 

That "almost" deserves some discussion, 
though it is not the main problem of this 
paper. The seventh criterion, the TAT, 
showed no change during therapy, but a 

2 Oversimplified, the theory of time limits 
in therapy is that healing is not a function of 
time, but of energy, or quality of experience. 
Whatever health-giving that can happen 
"sooner or later" can happen sooner. This could 
be flippantly put as the inverse of Parkinson's 
Law, "work expands in proportion to the 
amount of time available for its completion/* 
But there is a serious and profound theory, 
culminating in Taft's (1933) well-known state- 
ment of the "single contact," which deserves 
careful attention and which was the theoretical 
basis for this study. 
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startling and unmistakable decline in the 
follow-up period (Henry & Shlien, 1958). 
Such contradictions of criteria, when all 
had been adopted in equally good faith, 
are perplexing, intriguing, and cannot be 
passed over lightly. 

CONTRADICTION OF CRITERIA 

What can our position be when faced 
with such a contradiction? We cannot 
take the role of the student of human 
nature, who can balance the problem of 
the "whole man" in all his diverse aspects 
against the possible unity of the "inte- 
grated personality." We have no such 
easy accommodation. For us, these are 
criteria. We measure our work by these 
standards. Shall we expect contradictions 
as a part of nature, or try to resolve them? 
In the present state of clinical measure- 
ment, cultural diversity, and incomplete 
psychological conceptualization, I believe 
that we must expect some contradiction. 
When a study such as that by Little and 
Shneidman (1959) can conclude that for 
some of our major instruments the 
Rorschach, TAT, MAPS, and MMPI 
"agreement on diagnoses will be only 
slightly better than chance," there cannot 
be much hope for still better agreement 
between such clinical instruments and 
other types of ratings, reports, or scores. 
As things now stand, we could introduce 
a contradiction almost at will, simply by 
continuing to add another test (of the 
many established ones) to the battery 
until the desired result was achieved. For 
that matter, a battery of total agreement 
would rest uneasy upon the researcher, 
who might feel dismayed rather than 
fortunate to find all his measures so well 
related, for as Campbell and Fiske (1959) 
point out, a test must show some dis- 
criminant capacity in order to justify 
itself. Then there are discriminations 
within discriminations. Not only are diag- 
nostic instruments at some variance, but 
there are somewhat separate "vantage 



points'* from which criteria come, or are 
viewed, and within which those instru- 
ments may operate differently. Cartwright 
and Roth (1957) report posttherapy fac- 
tors in an analysis of ten outcome vari- 
ables. There are three faaors: client satis- 
faction, therapist view of success, and 
client response to others, and on the sec- 
ond factor, "the therapist stood alone in 
his views." Recently, a larger scale study 
by Cartwright, Fiske, and Kirtner indi- 
cates that the TAT may stand alone also. 3 
From these technical considerations, one 
might indeed expect criteria to contradict 
each other some of the time. 

Just beyond the clinical instruments 
lies the culture, full of conflict and ignor- 
ance about what constitutes criteria of 
"adjustment," "mental health," etc Popu- 
lar norms still judge the concrete be- 
haviors which order a citizen's rank in 
mental health, and we psychologists by 
and large accept their judgment. In this 
sense, clinical psychology is in a rudimen- 
tary stage. Scott (1958), writing on re- 
search definitions of mental health, says, 
"The public picks the cases still." They 
send patients, and the hospital makes its 
diagnoses somehow. Scott suggests that 
the public will continue to define mental 
health or personality defect until we diag- 
nose everyone. This is an interesting 
notion, but to carry it out would not 
create so much change in the situation as 
it would consternation in the public; our 
diagnostic or "change measuring" instru- 
ments (being one and the same a mis- 
take in itself) are usually built of the 
very same concrete, specific, and mundane 
behavioral traits that "the public" has 
used. Thus our inventories ask, "does your 
stomach rumble"; "are you afraid of 
mice"; "are you intelligent"; "feel ready 

3 Preliminary evidence from a factor analysis 
of a very broad range of criteria indicates that 
the TAT factor is remarkably separate, with 
no loadings on anything else, nor other factors 
loading on it. (Personal communication from 
D. Cartwright and D. Fiske). 
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to go to pieces"; "like mannish women"; 
"disgusted by sex"; "never finish work"; 
"have temper tantrums"; "want to be a 
florist"; "smoke too much"; and the like. 
So far, most of our "operational" defini- 
tions of healthy personality are linked, in 
a way which negates psychology, to "suc- 
cess" high grades, achieving power, 
making money, for instance. The problem 
here is that we have yet to develop psy- 
chological or psychiatric definitions of 
health which are independent of the cul- 
tural values of modern life (even though 
to many psychotherapists that life is con- 
sidered to be in many ways a failure). 
There are too few efforts to develop posi- 
tive concepts and measures, and they will 
have to fight their way clear. There is too 
little confidence in psychological values. 
Unfortunately we are forced into culture- 
bound concreteness, and since the culture 
is somewhat ignorant, the specifics it offers 
as criteria are not appropriate to take the 
full measure of change in psychotherapy, 
for the most part. The important end of 
the therapy process, as far as measurement 
is concerned, is the termination point, 
not the beginning. But the public gives 
us criteria which are no more than com- 
plaints having to do with the beginning 
those things which repel, irritate, frighten 
whatever makes one person so trouble- 
some to others that he is called "mentally 
sick." Elimination of such troublesome- 
ness is not the achievement of health, but 
many of our criteria are built as if it were. 
Then dimensions which were not even 
present at the beginning of therapy enter 
in when health is achieved, and these 
dimensions have no opportunity for ex- 
pression in even a passive sense. As a 
theoretical example, the elimination of 
slavery is not immediately translatable, by 
subtraction, as freedom. Slavery is rather 
easy to define in concrete and specific 
ways. Freedom is a more abstract realm of 
behavior, not because it is mystical, but 
precisely because the behaviors it will 
contain are far less easy to observe, speci- 



fy, or predict. That is part of the nature of 
freedom. Control is in the hands of the 
free person. So it is with sickness and 
health. Sickness lends itself to observation 
and description easily; health does not. In 
more literal psychological terms, when in- 
security ends and security is achieved, a 
contingent dimension (according to W. I. 
Thomas) comes into play i.e., venture- 
some seeking of new experience. But we 
are not given "venturesome" at one end 
of the security insecurity scale. For the 
most part, clinical scales are still in the 
elementary stage of the discomfort-relief 
type of conception, and after the discom- 
fort is relieved, what then? 

It seems that so long as clinical instru- 
ments remain unreliable, and "noncon- 
vergent," some behaviorally concrete and 
some conceptually abstract, most residual 
and a few positive, most reflecting the 
ordinary cultural concerns and a few 
being psychologically independent, there 
will be contradiction among criteria. This 
need not be a complete roadblock to con- 
clusions in research, but neither is it a 
situation which leaves one content. In the 
experiment on time-limited therapy in 
which this problem was encountered, the 
force of the contradiction was to lead us 
to a replication 4 for a second test. That 
is, of course, not a solution. It is only a 
pause for reappraisal. It was in the course 
of this replication that another phase of 
the "level of abstraction" problem de- 
veloped. 

PRIMARY PROBLEM IN CONTEXT 

From this point on, I will be dealing 
with the barest outline of the total experi- 
ment, and some sketchy descriptions of a 
particular part of it, not to give detailed 
proof but to illustrate the case of one 
variable pursued through different levels 
of abstraction. The variable in question is 
self-esteem. The outline of some results 



4 Not exact, m that one condition the brand 
of therapy was changed. 
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Figure 1. Average levels of self-ideal correlation in three experimental groups. 



which led to this pursuit is seen in Figure 
1. That chart shows average levels of self- 
ideal correlation for three experimental 
groups one unlimited in time and com- 
posed of clients who voluntarily termi- 
nated, and two other groups which were 
limited in time to 20 interviews. The first 
question about level of abstraction arises 
from a comparison of two of these 
groups; the two which are client-centered, 
one time-limited, the other unlimited. An 
answer to this question will lead to a 
complication in the second comparison 
between Adlerian time-limited therapy 
and client-centered time-limited therapy. 
All of these results are in terms of corre- 
lations between self and ideal "Q sorts," 
but this discussion is not about Q tech- 
nique, or Q methodology. The "<g sort" 
was born to be factor analyzed (Stephen- 



son, 1953) and here we are considering 
only the correlation between self and ideal 
descriptions, which could be (and have 
often been) given via any sort of inven- 
tory. It is the instruction ("describe your- 
self as you are" and "describe yourself 
as you would like to be") that matters. 
The correlation between these two de- 
scriptions can be called discrepancy or 
congruence (and is often called both by 
the same writer). 

Can such a correlation or ratio justifi- 
ably be called self-esteem, as Butler and 
Haigh (1954) suggest? This is precisely 
the way it has long been conceived and 
"operationally" derived. Fifty years ago, 
William James wrote, "It is determined 
by the ratio of our actualities to our sup- 
posed potentialities; a fraction, of which 
our pretensions are the denominator and 
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the numerator our success: thus 



Self-esteem 



Success 



Pretensions 

Kurt Lewin's ratio of "level of aspiration" 
to "level of achievement" is a similar 
derivation for self-esteem. Is self-esteem a 
variable of significance in psychotherapy? 
I have never met a therapist of any per- 
suasion who did not think it absolutely 
essential, of the highest importance. As a 
final note, it is a psychological construct, 
a personal feeling, independent of any 
particular content or culture, and thus 
capable of being raised beyond the level 
of specific behavioral traits. 

Returning to this problem as it arose 
in context: In the original comparison 
between the two dient-centered therapy 
experiments, one time-limited and the 
other unlimited (Figure 1), each popula- 
tion had been measured on the self-esteem 
variable by use of a somewhat different 
)-sort deck, though the same self and 
ideal instructions were given in every in- 
stance. The question at this point was 
simply can these two populations be 
compared? Can these two decks be con- 
sidered a single instrument? For the un- 
limited group, the original Buder-Haigh 
100-item deck was used (Butler & Haigh, 
1954). For the time-limited group, that 
deck was modified, reduced to 80 items, 
balanced for positive and negative state- 
ments, some items eliminated because 
they were "chronic neutrals," and a few 
new items added, 5 The question was an- 

5 The primary reason for this modification 
is of practical interest for researchers. It was 
to reduce the amount of time required for 
administration of the test, which was given at 
four points, and required up to an hour for 
each administration. Increase or decrease of 
items from a base of 100 seems to increase 
or decrease in roughly geometrical proportion 
the amount of time required. We found that 
an 80-item deck required on the average one- 
half the time it took to sort the 100-item 
deck. It was our principle, to put it wryly, 
that "the testing battery should not take more 



swered easily enough. Three population 
samples, providing the appropriate client 
and control range of distribution of 
"scores," (i.e., self-ideal correlations) were 
given both the 100- and the 80-item decks 
to sort, half taking the 80 items first, 
Within a few days, each individual sorted 
the remaining deck, always using the same 
self and ideal instructions. The self -ideal 
correlations from each deck, when corre- 
lated for each individual in the three 
samples (total N=45), yielded r's rang- 
ing from .77 to .91, averaging ^=.82. 6 
These are on the average as high as the 
best reported reliabilities for Q sorts, and 
we may feel fairly comfortable in compar- 
ing as equivalent those self -ideal correla- 
tions from Q sorts which have the same 
design and a good deal of overlap in "trait 
universe." But here a more interesting 
problem comes into view. How much 
difference can there be in a set of items 
before the items begin to influence or out- 
weigh the sorter? As Briggs and Wirt 
(I960) put it, "The jQ-sort technique 
produces an amalgamation of sorter, sub- 
ject, and jQ-deck characteristics which are 
difficult to refract." The problem can be 
put in an even more intriguing way. Is 
there an abstract entity, an internal self- 
ideal relationship (congruence or discrep- 
ancy) which exists within each person's 
consciousness of himself m a general sense, 
and which will be projected upon or rep- 
resented through any set of items? To 
what extent is this measure of self-esteem 
a core of feelings, independent of the 
cultural traits usually offered as concrete 
avenues of its expression? And if there is 
such a psychological entity, which cuts 

of the client's time than he had hours in 
therapy." This is a serious matter. To ignore 
it may mean that one collects a great deal of 
data which is clouded in its meaning by factors 
of fatigue, resentment, and carelessness. The 
average client in research spends 10 to 25 hours 
taking tests. 

6 Z transformations have been used through- 
out where needed. 
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across a variety of self descriptive items, 
would there still be a particular set of 
items which would be most truly repre- 
sentative of the self-ideal relationship 
within a given individual? 

SEARCH FOR EVIDENCE OF AN 
ABSTRACT ENTITY 

To explore these possibilities, three 
other sets of items were casually selected. 
One was a set of 50 items taken at random 
from Hilden's Manual of 1,000 items 
(Hilden, 1954). Another set was found 
in the list of 49 value adjectives, presented 
as a check list form by Bills, Vance, and 
McLean ( 1951 ) . It is rated on a five-point 
scale, and can be easily administered under 
self and ideal instructions. Finally, after 
these sorts were executed, each subject 
was asked to make up a list of 25 state- 
ments about himself statements he (or 
she) would consider personally significant, 
whether positive or negative. 7 One might 
expect that this last set of items would 
have the most stability (in an ordinary 
test retest reliability sense, though it 
might show the greatest volatility in a 
change inducing situation such as therapy) 
and most meaningful and accurate repre- 
sentation of self -ideal congruence. On the 
other hand, however much one might ex- 
pect generality and overlap of these pri- 
vate items from person to person (and I 
had no expectations on this point, in either 
direction) there was amazingly little. Of 
course, these people had just been through 
four other inventories of a more conven- 
tional sort, running the usual gamut of 



7 Surely this is very close to the recommenda- 
tion given by Stephenson for the most valid 
approach to the unique qualities of each per- 
son's attitudes and experiences. The reader can 
get an idea of how unique these items might be 
by referring to the case of "Dora." There, for 
instance, items read, "I have a tragic mouth," 
"I can be ill from longing," "Physicians I 
spurn," etc. It is striking to compare these to 
the conventional Q or questionnaire items 
(Stephenson, 1953). 



categories, and may have been trying to 
"say something different" about them- 
selves. At any rate, there was practically 
no overlap in items from one person to 
another, and no item common to all Even 
with broad categorical interpretation, at 
least 50^0 of the private items would 
remain unique. 8 

From this, you can see what is to follow. 
We have five "decks," all to be sorted by 
the same individuals, using always the 
"self" and "ideal" instructions. These five 
are abbreviated as the 100-g, 80-g, 
50-H<2, Bills Index, and 25 idio-g. 

A group of subjects was given the task 
of sorting, for self and ideal, all five of the 
decks. This is a task of considerable cost 
in effort and time and was performed in 
two or three sittings, ranging over a 
period of three to ten days. The subjects 
numbered 27 (though only 19 gave com- 
pletely usable data on all five sorts) and 
they were obtained on a volunteer basis, 
without client status, research obligations, 
or any special motivation, 9 The tasks were 
carried out in the order given on Table 1. 
Table 1 is a set of illustrative data, show- 
ing a sample of ten cases which include 
the lowest and highest "scores" (Self-ideal 
r ) from the total sample, plus eight other 

8 Professor George Klein has suggested that 
if people could sort each other's items, for 
themselves, with the same results as were ob- 
tained on a general, conventional deck, that 
would be overwhelming proof of existence of 
an abstract entity. I did not try this, and feel 
that it would be interesting, indeed over- 
whelming, but likely to fail. The "entity** need 
not be that abstract, nor is blindness to the 
other's unique items a required proof of "ab- 
stractness." 

9 Much gratitude is due to Drs. Galatia 
Halkides and Virgil Willis who, as research 
assistants, obtained this and other data from 
friends, relatives, students, hospital patients, 
or other willing sources. The fact that the in- 
vestigation was not conducted with more vigor 
is no fault of theirs. This was a side issue to 
a main project, and was carried out in spare 
time through motives of new curiosity as each 
step developed. 
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cases taken at random from the total 
sample of complete cases, all ordered by 
their first column rank Scanning across 
five columns for each individual, Table 1 
shows evidence of a conspicuous degree 
of stability for the sorter. One can predict 
any person's score from deck to deck 
better than one could predict from person 
to person within any column. From in- 
spection of this sample, one can tenta- 
tively conclude that there is some internal 
sense of self -ideal congruence (or dis- 
crepancy) which has a greater influence 
upon the sorting than does the effect of 
the written statement presented as oppor- 
tunities for that expression. That does not 
posit an unvarying psychological entity, 
nor does the evidence suggest anything of 
the kind. The table of interpretations 
(Table 2) tells us that there is a moderate- 
ly high level of agreement between the 
ranks of most self -ideal correlations on all 
decks or sorts or inventories used, and in- 
spection of the two directions of vari- 
ability in Table 1 suggests that the agree- 
ment comes more from the outlook of the 

TABLE 1 

ILLUSTRATIVE SAMPLE SHOWING TEN SUB- 
JECTS' SELF-IDEAL CORRELATIONS ON FIVE 
DIFFERENT Q-SORT DECKS OR INVENTORIES 
(PARTIAL DATA) 

Bills W 
Subject 100-Q #0-Q 50-HQ Index idio-Q 



TABLE 2 
INTERCORRELATIONS 



100-Q 80~Q 5Q-HQBills Index 



Fi 


-.32 


.21 


.02 


.16 


-.12 


Jo 


.08 


.30 


.09 


-.06 


.13 


Ro 


.14 


.40 


.21 


.33 


.31 


De 


.32 


-.19 


-.16 


.50 


.35 


Kl 


.53 


.74 


.65 


-.34 


.58 


Ad 


.57 


.70 


.66 


^49 


.48 


Ne 


.67 


.64 


.74 


.65 


-.59 a 


Gr 


.78 


.70 


.83 


.92 


.68 


Ot 


.81 


.72 


.43 


.79 


.67 


Sp 


.91 


.95 


.96 


.90 


.93 



a This minus coefficient seems highly incon- 
sistent; it may be one of those occasional mis- 
haps in which the order of piles is inadvertent- 
ly reversed either by the sorter or the psycho- 
metrist. 



8o-e 


.82 








50-HQ 


.65 


.69 






Bills Index 


.50 


.65 


.66 




25 idio-Q 


.58 


.68 


.75 


.56 



Note. This table is made up of all the 
data available, so that some of the intercorrela- 
tions are based on an N=45, some less, as 
few as N=19. Again in keeping with the in- 
structions to the conference, this is not intended 
to be a detailed description of research, but 
an illustration of the theoretical problem under 
discussion. 

sorter than the influence of the items 
sorted. If, from this, one takes the notion 
that the abstract entity does exist, and that 
it weighs more heavily than do the con- 
crete trait descriptions, one is moved to 
wonder if this effect cannot be more 
highly abstracted. If completely removed 
from the level of imposed verbal trait 
descriptions, what stability would such a 
measure have, and what would it mean? 
After brief consideration, and still on 
an exploratory basis, an apparatus was 
constructed (Figure 2) to present the 
possibility of a ratio of correlation on a 
nonverbal level. Presumably each indi- 
vidual would use his own total estimate 
or his situational response as a measure 
of his self -ideal congruence. This appara- 
tus is simple, and consists of two semi- 
transparent curved circles which can be 
moved through 180 degrees by the sub- 
ject, so that they are back to back, com- 
pletely opposite (a -1.00 correlation), or 
centered together, so that they completely 
overlap, (a +LOO correlation) or any 
point between these extremes. The sub- 
ject is told to think of one circle as repre- 
senting his "self," the other his "ideal," 
paraphrasing the usual sorting instruc- 
tions. He faces the circles, moves them to 
suit himself, until he is satisfied. On the 
back stand, hidden from his view, are 
notched pointers, one attached to each 
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Figure 2. Abstract Apparatus 1 (rear view). 

circle arm so that they indicate the angle 
of separation between the circles. The 
psychometrist makes a pencil mark in 
each notch, notes the angle, translates it 
from an adjoining table as the cosine of 



the angle between two vectors, and records 
it as a correlation coefficient. (Actually, 
there is no advantage to this over any 
other ranking system, except that it per- 
mits us to continue to speak of the "self- 
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ideal correlation," and gives an over- 
worked psychometrist the feeling of hav- 
ing accomplished a tedious computation 
in no time. The entire procedure, from 
portal to portal, takes three minutes or 
less.) 

In order to test the stability of this level 
of abstraction as a measure, a second in- 
strument was devised. It is still more 
simple, composed of two frosted 12-inch 
squares of plexiglass, which slide in 
parallel tracks so that they can touch 
edges, overlap completely, or be fixed at 
any in-between point. Again the self -ideal 
instructions are given, and the degree of 
overlapping variance is read off a hidden 
scale on the back This second apparatus 
(not shown, but henceforth called Appa- 
ratus 2) is, like Apparatus 1 (Figure 2) 
an admittedly crude and imperfect piece, 
not as refined as need be for extensive use, 
but satisfying for the exploratory nature 
of this investigation. 

When the abstract measures, Apparatus 
1 and Apparatus 2, were given to a group 
of 20 undergraduate psychology students, 
with the 80-item Q sort given between the 
two abstract measures, the correlation be- 
tween the two abstract measures was .81. 
This abstract level, then, has as much 
stability as the average reliability of the 
Q sorts, or as much convergence as the 
100- and 80-item Q sorts which have con- 
siderable overlap in items. Clearly, what- 
ever goes into the subject's abstract judg- 
ment of self-ideal discrepancy, it is as 
stable as if he were using a forced sort 
and a deck of concrete items. 

However, when these two abstract 
measures are correlated with the inter- 
vening conventional 80-item g-sort self- 
ideal given to those 20 students, the rela- 
tion is lower. Between Apparatus 1 and 
the 80-item self-ideal correlation, f=.39; 
between Apparatus 2 and the 80-item 
self-ideal correlation, r=A8. (Another 
sample of 20 cases, half "normal controls** 
and half Veterans Administration "mental 



patients," used the 80-item self -ideal sort* 
and Apparatus 1, yielding a product 
moment correlation of .42.) When 12 oi 
those 20 students were recaptured withir 
the month and prevailed upon to write 
the 25 personal statements significam 
about themselves, and to sort those per 
sonal statements under self and ideal in 
structions, again the items were highl) 
unique. The rho between the persona 
25-item self-ideal correlation and th* 
"score" on Apparatus 1, pooled with those 
same cases and Apparatus 2 (for a tota 
N of 24) yielded a rho of .67, This it 
roughly twice as large, in terms of predk 
tive power, as the relation between the 
abstract apparatus measure and the 80 
item deck of concrete conventiona 
items. 10 That is to say, the concrete item< 
made up by each individual, unique anc 
personal to him, are much more relatec 
to the demonstrated abstract entity thar 
are the conventional concrete items whid: 
are more common to the population. Ii 
would seem that these private items arc 
the sorts of considerations which compose 
one's self -ideal disparity. For the sake oi 
the theoretical argument in this paper, 3 
will make an exaggerated interpretatior 
of these findings and assert: the most ab- 
stract is also the most concrete (thougi 
in a very special sense). 31 The "abstract* 

10 Butler (1956) has found a single idea 
factor which he calls a "common cultura] 
ideal." When Dymond (1954) had six judges 
sort the 100-item deck into two piles, on 
"well-adjusted," the other not, the range oi 
discrepancy between any two judges was be- 
tween two and four items. The conventional 
deck does seem to have a heavy component oi 
what Edwards (1957) calls the "social desir- 
ability variable," and this is much less evidem 
in the "idio-Q" or personal items invented b> 
each subject for himself. 

11 Granted that this is what one could sa> 
unequivocally only if repeated experiments pro- 
duced a correlation of 1.00 instead of the .67 
given. But I am reminded that one of the mosi 
enduring and forceful ideas in psychology, the 
frustration-aggression hypothesis, was based on 
evidence such as a correlation of -.66 between 
cotton prices and lynchings in the South. 
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is not really empty; it has implicit con- 
crete meanings in the consciousness of the 
individual, and at least some of these can 
be made explicit. Perhaps it would be 
better to say that the abstract is the most 
general, in that each individual can apply 
it to his own unique concrete. 

REVIEW 

Thus far, we have followed the develop- 
ment of an important variable in person- 
ality change through several stages. Self- 
esteem was a theoretical "given" to begin 
with. It is supposedly universal, but of 
what content each man's personal measure 
is composed we do not know, unless we 
ask. It cannot be observed directly, but 
may be derived from a ratio of some per- 
sonal judgment having to do with what 
one is, and what one wants to be. This 
we are given, at the beginning, as a psy- 
chological concept by theorists such as 
William James, Kurt Lewin, and Karen 
Horney. Later, researchers developed an 
empirical substantiation of this concept 
and its derivation, using the self -ideal Q 
sort (Butler & Haigh, 1954). Such sub- 
stantiation brings the concept "down to 
earth" for a test, grounding it in a list of 
commonly observed concrete behavioral 
descriptions. This paper has discussed an 
exploratory study which gives evidence 
to the effect that the individual concept 
of self-esteem does not depend upon, or 
vary greatly when confronted with, differ- 
ent sets of common behavioral descrip- 
tions. This suggests that self-esteem oper- 
ates and can be measured at a higher level 
of abstraction. At a further stage of in- 
quiry, self-esteem is demonstrated to be 
measurable without the use of any ex- 
plicitly stated behavioral descriptions. 
This appears to be a very high level of 
abstraction, returning in apparently con- 
tentless form to the ratio given by those 
original conceptualizes. Yet it seems that 
the abstract form is not truly without 
reference to any content at all, for in the 
most crucial point of the exploration, the 



abstract is found to be more closely linked 
to the behaviors invented by each person 
to describe himself than to the conven- 
tional behaviors common to a population. 
For purposes of argument, I have drawn 
these conclusions: 

1. There is such a thing as an abstract 
psychological entity, approachable by 
measure. 

2. In this case the example of self- 
esteem, derived from the self-ideal rela- 
tion, is a model of such an entity. 

3. The highest level of abstraction is 
the most general, i.e., best applied to the 
uniquely concrete by each individual It 
will contain the personally significant con- 
crete, though it will not specify it. 

RESEARCH-WISE, WHAT OF IT? 

If you can accept the foregoing as a 
demonstration that self-esteem can be 
measured at either a more abstract or 
more concrete level, which way is dictated 
by what aims? Look again at Figure 1, 
representing the experiment from which 
this problem developed There is another 
comparison to be made between two 
groups; one Adlerian and time-limited, 
the other client-centered and also time- 
limited (Shlien, Mosak, & Dreikurs, 
I960). In this comparison, both groups 
used the identical 80-item Q sort. With 
respect to the means for each population, 
the groups were not distinguishable at any 
of the three testing points from pre- to 
posttherapy. That is the complication 
mentioned earlier. These results tell us 
something significant we wanted to know 
about time limits in therapy, but do they 
tell us all we need to know? If they do, I 
believe that we could have obtained the 
same group means through use of the ab- 
stract apparatus, with a saving in time 
which would have enabled us to use an- 
other test (perhaps to encounter another 
contradiction! ) . But we used the Q sort, 
having in mind to subject it to analysis 
for different clusters or factors in each 
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population, because we know there are 
differences in the therapy, in the popu- 
lations, in the outcome, in some way. We 
would "know" this even if the item 
analysis did not show it to be so. Or 
would we? Perhaps we are in danger of 
being like the essayist who wrote, "All 
food is the same, being limited to a nar- 
row range within which gourmets pretend 
to find exquisite distinctions." In that case, 
all of our close analysis is an exercise in 
technical virtuosity, and the abstract 
measure of outcome is sufficient. On the 
other hand, such a measure is at least 
vulnerable to the criticism of "placebo 
effect" without means to test or counter 
it. Then we are in danger, if there are 
differences as we believe, of overlooking 
them. In that case the development of the 
abstract measure is itself only an exercise. 

It would seem, then, that a compromise 
solution is most reasonable. The variable 
of self-esteem has been tested and proved 
on the ground and in the air, as it were. 
The Q sort or an inventory can provide 
both the ratio and the concrete behaviors 
which will separate groups or individuals 
having identical "total scores." Then the 
question is are these the significant ways 
in which one wants to discriminate? Does 
it matter whether one "smokes too much," 
etc. Unless these behavioral items cluster 
into a complex which itself is a higher 
level of abstraction, these concrete differ- 
ences are only at the level of "complaints," 
not personality variables. The lowest level 
of concreteness may be necessary as a base 
of observation for the beginning of meas- 
ures of change., but until they cluster into 
intercorrelating sectors, they do not begin 
to qualify as measures of "personality" 
change, and I would argue that until the 
measure has been raised to a higher level 
of abstraction, it is not significant. For 
research in psychotherapy this is a special 
problem; we speak of change as taking 
place in terms of concrete "items" (he no 
longer "smokes too much"). But this, I 



believe, is only apparently so. "Manifesta- 
tions" are simply easier to observe and 
describe than are "causes." That does not 
signify their importance. Any variable 
which can be observed only at a concrete 
behavioral level is not a very important 
psychological basis on which to discrimi- 
nate between people. Still, the necessity 
to make discriminations remains. The ab- 
stract level of measurement could accom- 
plish this only under ideal circumstances, 
as yet far from achieved. If the important 
variables could be raised to a high level of 
abstraction, and could be made practically 
economical, theoretically sound, technical- 
ly pure, they could in combination make 
the kind of change measures which would 
enable significant discriminations without 
resort to elementary behavioral items. 
Until this is achieved, the abstract meas- 
ure has limitations for the researcher 
which make it useful only in gross ways. 
Even so, it is not just a worthless exercise. 
Any variable, whether it originates in the 
armchair or Univac, should be validated as 
a psychological concept. In the instance of 
the example in this discussion, self-esteem 
was followed through its course from arm- 
chair to behavioral items and then to a 
demonstration of its abstract reality. 
"Tolerance for ambiguity," "Ego-Strength," 
or other thought-originated concepts could 
be treated in the same way. On the other 
hand, variables which begin "on the 
ground," as it were, in "hypothesis gen- 
erating" studies (from factor analysis, for 
instance), could profit from the test of 
being raised to a higher level of abstrac- 
tion. If they cannot meet this test, per- 
haps they are transitory and insignificant. 

I have the hunch that the most im- 
portant personality variables we could 
deal with are those at least capable of, 
perhaps even demanding, a high level of 
abstraction for their best measurement, 
and the most important variables are best 
measured abstractly. Self-esteem is one. 
There are others for example, honesty 
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and courage. These are variables of per- 
sonality, capable of change, susceptible of 
influence by psychotherapy. As for their 
importance: if and when they are achieved 
to a high degree, there is very little more 
a therapist can do, as a therapist, for his 
client or patient. (For that matter, if 
everyone were honest and courageous, 
would there be any need for psycho- 
therapy at all?) // these variables are so 
significant, why are they not being meas- 
ured and used? I believe it is because the 
concepts are highly abstract, and need to 
be measured at that level, where we have 
least confidence and experience in careful 
measurement. We cannot offer a check 
list of behavioral items to tap the content 
of these qualities in each individual. The 
content is too various, and we cannot 
know the range or weights of the general 
list of behaviors. Moreover, these abstract 
concepts have never been formulated in a 
way comparable to the theory of self- 
esteem, as that concept gave us a model 
for this discussion. 

SUMMARY 

Two problems resulting from a com- 
parative study were discussed. With re- 
gard to the contradiction of criteria, it 
seems that there is not enough unity 
among instruments, sources of opinion, 
or level of abstraction to permit us to 
anticipate complete agreement. A particu- 
lar case of the problem of level of abstrac- 
tion was illustrated, using self-esteem as 
the example. It was argued that such a 
variable can be demonstrated to have an 
abstract status, somewhat independent of 
conventional lists of behaviors, and most 
highly related to the behavioral items 
specific and unique to each person. The 
abstract measure is valuable where gross 
comparisons are sought, though it will 
not separate individuals where differences 
at more concrete levels may exist. The 
researcher's aims will dictate which level 
is most useful. Above all, it is argued that 



the most important variables are psycho- 
logical, i.e., not the elementary behaviors 
which can be observed only on the most 
concrete level, but those concepts which 
can apply generally to a wide variety of 
concrete behaviors. Whether or not the 
most abstract level of measurement is 
used, the fact that it can be abstracted is 
a standard of its psychological significance. 
The final solution may lie in the develop- 
ment of measures at a high level of ab- 
straction in several distinct areas, so that 
desired discriminations may be made by 
combination without resort to descrip- 
tions of behaviors which are by them- 
selves not significant. 
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Discussion of Papers on 
Measuring Personality Change 

NEVITT SANFORD, PH.D. 



It has seemed to me that sooner or later 
we would need an over-all scheme em- 
bracing variables in the patient, in the 
therapist, and in the processes of their 
interaction. It is not possible to segregate 
the several topics that we have been as- 
signed. The task of our group, as you 
know, is to talk about variables in the 
patient's personality, but it seems clear 
that if we are going to formulate person- 
ality we should use the same terms for the 
therapist that we use for the patient. 
Again, Dr. Lorr's paper is concerned 
mainly with certain aspects of the process 
of therapy with the frequency of therapy 
sessions, and duration of the whole enter- 
prise but he studies these things in rela- 
tion to a judiciously chosen set of objec- 
tive measures of personality. Dr. Luborsky 
sticks pretty closely to variables in pa- 
tients, measured on two different occa- 
sions, but looking at his variables it is not 
too difficult to make some inferences as 
to what the therapy must have been. We 
can be pretty sure that there was long- 
term therapy, and psychoanalysis. Dr. 
Shlien is concerned with the philosophy 
and strategy of selecting variables for 
study, and he naturally relates these prob- 
lems to the processes of therapy and to the 
interests of the therapist. It seems to me 
that we need a scheme of the sort that I 
have sketched below (Figure 1). 

Now I would argue that the same gen- 
eral scheme that holds for psychotherapy 
holds also for other kinds of change-agents 
or agencies that are brought to bear from 
time to time in our society. Psychotherapy 
probably ought to be regarded as a special 
case of interpersonal relationships; and 
changes in the person that occur in psy- 



chotherapy ought to be regarded as special 
cases of change in general. After all, we 
are interested in changing people, or in 
enabling people to change, or in creating 
conditions under which they can change 
in directions that they favor. We will do 
well to look for alternatives to psycho- 
therapy. Our aim should be to know 
enough about personality how it de- 
velops, how it functions, how it changes 
so that other kinds of instrumentalities 
in addition to psychotherapy can be made 
available to people. We may hope to 
utilize what has been and is being used in 
psychotherapy, but probably there will 
never be enough psychotherapists to help 
all the people who want or need it. More 
than this, if we look now for alternatives, 
we may get some fresh ideas about what 
might be done in the therapeutic relation- 
ship. 

In our model there is a person who 
enters into some kind of situation that has 
been designed with the general objective 
of changing him or promoting his growth. 
This scheme holds not only for psycho- 
therapy but for various other situations as 
well. It holds for an educational institu- 
tion or program, and for a correctional 




CHANGE-SYSTEM 
(Embracing Sub-systetns) 



Figure 1. Model of psychotherapy or of any 
social system designed to change the person 
who passes through it. 
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institution or a summer camp or encamp- 
ment for citizenship. It holds for inter- 
views and for bringing up in the family. 
In all these cases there is some kind of 
agency or system or set of processes de- 
signed with the object of inducing 
changes that will accord with somebody's 
hopes or expectations. 

Concerning objectives, it seems safe to 
say that we, as psychologists, want to see 
people develop, we want to help them 
become whatever they can become. These 
are the terms we use in education and 
they seem to be readily applicable to psy- 
chotherapy as well. We do not have to 
look very far, however, to see that differ- 
ent people have in mind quite different 
kinds of objectives. 

One of the most interesting aspects of 
the whole scheme is the change-inducing 
process or processes. In psychotherapy the 
therapist is, of course, central, but he is 
not everything. If our concern is with 
group psychotherapy, other clients or pa- 
tients have roles in the process. Even in 
person-to-person psychotherapy there are 
various conditions governing the relation- 
ship between the entering person and the 
change-inducing system. For one thing, 
there is the question of how hard it was 
to get into the system. The opening, we 
might say, varies in elasticity. Whether 
we are concerned with a school or with a 
psychotherapeutic relationship, the ques- 
tion of how hard it was to get into it 
might have an important bearing on what 
the final outcome will be. If one can 
secure the services of a highly regarded 
therapist, the processes of interaction may 
well be different from what they would be 
if one settled for some less sought after 
therapist, and this regardless of the com- 
petence of the two therapists. The same 
holds for colleges. Some colleges have such 
prestige that students may well believe 
that once they have gained admittance 
everything will be done for them. Possibly 
the same thing holds in the case of the 



highly regarded therapist. If the therapist 
were a less highly regarded one, one might 
enter therapy with the expectation that 
he would really have to work, and the 
outcome might be different. 

What has just been said concerns any 
agency set up in order to change people. 
The same general considerations would 
hold for arrangements in which we under- 
took to investigate people over a period 
of time; we would still have to deal with 
the effects of the investigator in producing 
any change that has occurred. 

Dr. Lorr, of course, is concerned with 
certain aspects of the change agency the 
duration of the person's stay within it and 
the frequency of contacts with the thera- 
pist. The issues that Dr. Lorr raises have 
also been raised in education: should we 
have a system in which everything is 
speeded up in order to get people through 
in a hurry or to teach them as much as 
possible in a limited time, or should edu- 
cation proceed at a more leisurely pace so 
that experiences can "sink in" and new 
insights can be integrated with the stu- 
dent's actual life? Dr. Lorr finds that the 
frequency of the interviews doesn't really 
make much difference when the over-all 
time is constant. If the over-all time is a 
year, then probably as much is accom- 
plished by weekly interviews as with in- 
terviews twice a week. It is possible that 
educators can learn something from this 
finding. 

The processes that are brought to bear 
on the patient or client or student might 
be characterized as rational or irrational. 
Those who operate an agency for change 
usually have some kind of theory govern- 
ing what they do. They bring to bear 
certain influences which, according to 
some theory, will change the person in 
some desired way. But other influences 
may enter the picture, independently of 
the therapist or not intended by him, and 
they may have an important bearing on 
what happens. This corresponds well with 
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what is commonly to be observed in insti- 
tutions. Institutions are designed, in the 
first instance, rationally. Their activities 
are supposed, on reasonable grounds, to 
produce certain kinds of effects. But 
analysis of an institution after it has been 
in operation for a time will show that 
many of its activities have no conceivable 
relation to its stated objectives. For one 
thing, all institutions, once they have been 
set going, have to devote time and energy 
to self-maintenance; for another, institu- 
tions change their purposes, and instru- 
mentalities designed for an earlier purpose 
lose their function; but this does not mean 
that the instrumentalities will be given 
up; on the contrary, interest becomes 
vested in them, they come to serve various 
individual needs of the institution's mem- 
bers, and hence they persist as irrational 
features of the system. Small wonder that 
what happens to people who pass through 
the system is often unanticipated, and 
actual outcomes cannot be related to pro- 
cedures that were deliberately undertaken. 
Similarly, a person may pass through a 
long series of therapeutic interviews that 
were designed to reduce his symptoms or 
to relieve his suffering. It might be that 
neither of these things happens, but that 
he becomes in the end a psychotherapist 
himself. 

In considering the outcomes of pas- 
sages through change-agencies or change- 
systems, there are several possibilities that 
must be kept in mind. There may be 
change or no change. Change may be de- 
sirable or undesirable from various 
points of view. Changes that are desirable, 
from the point of view of the therapist 
or educator or reformer, may or may not 
be due to activities deliberately under- 
taken. 

This last confronts us with a difficulty 
of experimental control that is not always 
overcome in researches on psychotherapy. 
It is not only that a desired outcome 
might be due to some unrecognized ac- 



tivity of the therapist, but it may be due 
to e\ents outside the therapeutic situation 
altogether events not taken into account 
in the experimental design. As for research 
on the effects of college, I believe it still 
remains to be demonstrated that changes 
observed in college students were due to 
educational activities of the college rather 
than to something else, and that similar 
changes might not be occurring in people 
of the same age in quite different situa- 



tions. 



There are two further points about 
change. One is that the new state of the 
individual may be temporary or enduring. 
The only way to tell which is the case is 
by means of follow-up studies, examining 
individuals at various times after they 
have completed their passage through the 
change-system. It is common to examine 
people two years after they have com- 
pleted psychotherapy. In Dr. Luborsky's 
work there was follow-up after two years. 
Finally, it is important to ask whether it 
is change itself or the achievement of 
some absolute standard of health or ma- 
turity or excellence that we are interested 
in. In colleges nowadays there is enormous 
emphasis upon this latter objective, for 
example, upon the kind of excellence that 
insures that a student will be admitted to 
a good graduate school. Since it is sus- 
pected that the major determinants of 
this eventuality are in the student at the 
time he enters college, the tendency of 
colleges is to be very careful about select- 
ing students, less careful about what is 
done to or for them during their college 
course. Few colleges would care to base 
their reputations upon their ability to 
change poor students into mediocre ones. 
The same kinds of choices are, to some 
extent, open to the psychotherapist. It is 
one thing to work with patients who are 
interesting, attractive, possessed of many 
resources and socially valuable traits, and 
who were already practically cured once 
they had made up their minds to enter 
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psychotherapy; it is something else to 
work with unpromising characters who 
might change a great deal but still be 
rather unpromising characters. It is too 
much to ask that psychotherapists avoid 
patients of the first type, but perhaps it is 
not too much to ask that, like Freud, they 
accept various kinds of patients including 
some of the unpromising ones. 

Now let us turn to the major problem 
confronting the authors of the papers in 
this first group. To measure personality 
change in psychotherapy we have to have 
variables of personality, and this means 
that we must first find some suitable basis 
for selecting and for defining such 
variables. Dr. Shlien has been concerned 
with the problem of selecting variables. 

It seems to me that our approach to 
this problem ought to be guided by a 
general theory of personality. This is not 
the place to offer such a theory, but we 
may at least note some of the considera- 
tions that affect our choices of variables. 

Let it be noted first that in Figure 1 
I have borrowed from Kurt Lewin in 
offering a conception of the person. 
Whether or not we put the "psychological 
environment" inside the personality, as I 
would be inclined to do, Lewin's distinc- 
tion between the psychological environ- 
ment and "the person" or "core per- 
sonality" as others might say is well 
worth making when it comes to the defini- 
tion of variables relevant to psycho- 
therapy. And in our formulation of "pa- 
tient variables" we should include also 
variables in the patient's situation of the 
moment, that is, in his nonpsychological, 
or geographical, environment. For exam- 
ple, strains arising from this environment 
may have an important bearing on the 
outcome of psychotherapy. 

Most psychologists are willing to think 
of personality as an organized complexity, 
a whole constituted of parts that are some- 
how organized. It is hardly controversial 
to speak of interactions among the parts 



and of interactions between the personali- 
ty as a whole and the environment. The 
great difficulty comes when we ask our- 
selves how we are going to conceive of 
the parts or elements of the personality. 
You will recall Allport's text (1937) in 
which he gave a great deal of attention 
to what he called "the search for ele- 
ments." This search for elements is still 
going on. Although progress has been 
made since 1937, many of the issues 
pointed up by Allport are still with us. 
One way to approach the problem is to 
make use of AngyaTs analysis (1941), in 
which he describes the possible ways of 
dividing a whole any whole a person, 
an animal, a plant, or anything. He refers 
first to simply making arbitrary cuts and 
dividing the whole into fragments. This 
is what we often do in practical work. We 
choose some variable that we think is re- 
lated to some important function in which 
we are interested. Psychologists can agree, 
for example, to rate "leadership" or "good 
social relations" when these traits are re- 
garded as important in some future role. 
Scientists of quite different theoretical 
persuasions can work on these arbitrarily 
chosen aspects or fragments of the whole. 
There is no necessity for agreeing first 
about "fundamentals." We can proceed 
this way in research on psychotherapy, 
without getting into any theoretical argu- 
ments, and focusing on some agreed 
"targets." 

Another way to divide a whole is ac- 
cording to a rigid fixed principle, for ex- 
ample, we might divide a tree into inch 
cubes. I don't suppose we have good ex- 
amples of this in contemporary psychol- 
ogy, but the old habit psychology pro* 
ceeded in such a way as this. A person 
was an aggregate of habits or S-R bonds, 
all of which were essentially alike in their 
structure. We needn't dwell on this be- 
cause the practice has been virtually 
abandoned. The third way of dividing, 
according to Angyal, is by abstracting fea- 
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tures of the whole, as when we speak of 
the health-sickness ratio, or of a person's 
ability, maturity, or soundness. In rating 
variables of this kind our reference is to 
the whole person. It is remarkable how 
willing we are to rate them without know- 
ing very much about the person in ques- 
tion. A rating of "stability" or "integra- 
tion'* should be based upon an enormous 
amount of knowledge of the person, but 
often we rate these things as easily as we 
rate gregariousness. Usually, of course, the 
reliability of such ratings exceeds their 
validity. But be that as it may, it seems 
that we can hardly do without such vari- 
ables in the study of psychotherapy. We 
must refer to the whole person sometimes, 
and this is one way in which we can do it. 

The final way to divide a whole is ac- 
cording to its structural articulation. One 
starts with a conception of the whole and 
asks how it is put together. Any element 
is defined in terms of its relations to other 
elements and to the whole. This is fairly 
un-American and I don't believe it is 
often done in this country. To find good 
examples in the work of psychologists, we 
have to go back to Freud and Jung, in 
whose work it was simply taken for 
granted that the psyche was a whole and 
that analysis called for its being divided 
into interacting elements or systems. I 
think this is one of the reasons for the 
durability of Freud's scheme. It is one of 
the few schemes we can use when we wish 
to talk about the whole personality. The 
whole is structurally articulated in the 
sense that one can't really describe any 
one of the elements at any particular time 
without paying attention to its relations 
to the other elements and to the whole 
personality. If we were to throw out 
Freud's tripartite scheme Id, Superego, 
Ego we would have to substitute some 
other equally comprehensive and equally 
articulated theoretical structure. 

Dr. Luborsky seems to have been 
caught on the horns of a dilemma here. 



The variables used in the research he 
describes are derived from the Freudian 
scheme. But the researchers must have 
been worried about what kind of quanti- 
tative treatment could be accorded these 
variables, for what we have in this re- 
search is not a theoretically integrated 
scheme but rather an aggregation of con- 
cepts that are mentioned from time to 
time by psychoanalysts and by other peo- 
ple of psychoanalytic orientation. It turns 
out, to no one's surprise, that one of these 
variables is correlated .93 with one other. 
One may ask why the researchers didn't 
have, in the first place, one variable to 
stand for whatever it is that has been 
measured twice. I think the researchers 
pulled back from the point of view of 
structural articulation, and chose instead 
the procedure of rating a lot of things and 
then seeing what comes out in the factor 
analysis. What comes out in the factor 
analysis tells us less about the structural 
articulation of personality than it tells us 
about the attitudes and preferences of 
psychologists. It is plain that the raters 
prefer a particular kind of person, one 
that we might call the well-developed or 
well-functioning person. 

(This desirability factor seems to come 
out in all factor analyses of rated traits. 
Psychologists have an ideal of the de- 
veloped person. We ought to make this 
more explicit and use this as one way of 
dealing with the problem posed by Dr. 
Krasner. Let us admit that there are cer- 
tain kinds of things that we value; for 
example, that we are interested in more 
people becoming better developed.) 

In general, it seems that psychologists 
in their search for elements or variables 
of personality have at one time or another 
used every possible way of dividing the 
whole. We seem to have used most often 
the method of taking random cuts and 
next most often the method of abstracting 
features of the whole. We have got over 
the practice of dividing according to a 
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fixed principle, bur we srill do not take 
readily to the method that has most to 
recommend it, that is, division according 
to theoretical structure. 

This last method requires, of course, 
that elements be derived from a general 
theory of personality. As Dr. XVallerstein 
pointed out, we do not have much con- 
sensus in this matter. Still, there is ground 
for hope. If we look over what has been 
happening since 1937, when Allport pub- 
lished his survey, it seems that we may 
note some convergent trends in person- 
ality theory. Theorists pay more attention 
to each other than they did 25 years ago. 
The boundaries separating schools are less 
sharply drawn than they used to be. Every- 
body is more aware of the complexity of 
personality than formerly, and there are 
fewer claims that a particular scheme will 
take care of everything. 

Concerning specific proposals for ele- 
ments, it seems that what Allport called 
"dynamic elements of the nomothetic 
order," e.g., needs, motives, striving, are 
still the prime variables of personality. 
This is true, I think, despite the fresh, 
and apparently still growing, emphasis 
upon cognitive variables. Cognitive vari- 
ables have come in for their innings not 
merely as instrumentalities of needs, but 
as motives in their own right. It is also 
fair to say, I think, that there has been a 
trend toward increasing accent on the 
higher mental processes, or perhaps on 
what is distinctively human as opposed 
to animal in personality functioning. 
Going along with this is an increased 
accent on the concept of the self and on 
the concept of ego considered as a 
"conflict-free" sphere. Associated with this 
last is an increasing tolerance of holism. 
Psychologists who talk about the self or 
ego seem quite willing to think of these 
systems of the personality as wholes, 
whose parts are always under the influence 
of system-wide processes. Finally, every- 
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body seems to be becoming more social 
in his conception of the personality. It 
would be almost unthinkable, for ex- 
ample, that a personality theorist today 
should omit all references to social role, 
role disposition, role conception, and so 
on. 

To these brief comments on trends in 
theory may be added a few considerations 
other than theoretical ones which help 
determine our choice of variables for de- 
scribing personality. One such considera- 
tion is the coarseness of the categories we 
use in analyzing behavior. One of the 
reasons for the hiatus between psycho- 
therapists and academic psychologists, I 
think, is that the psychotherapist is almost 
bound to use coarser analytic categories. 
He has such an enormous array of ma- 
terial to deal with that he has to work at 
the level of long units of behavior and to 
talk about things like needs, anxiety, and 
the like. He finds it impossible to reduce 
his material to elements as fine as S-R 
bonds, for example. All that we can ask 
of him is that he use categories that lend 
themselves to further analysis. And we 
may ask of the laboratory scientist that 
he use elements that can be built up into 
something that is meaningful at the level 
of practice. 

Another consideration has to do with 
the abstractness of the variables used. The 
psychotherapist is focused more upon the 
concrete than the experimentalist is and 
this is another reason for the difficulties 
between them. The psychotherapist has to 
talk with patients in their own language, 
and this will have reference to a very 
great many very specific and concrete de- 
tails. It is very difficult to move from 
this realm of discourse to the highly ab- 
stract terms used in reinforcement theory 
or a theory having to do with transactions 
among subsystems of the personality. I 
suppose we ought to try, nevertheless. 

This brings us to Dr. Shlien's ideas 
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about abstractness or concreceness in the 
self-conception. It seems to me that he 
may be confronting here the persistent 
issue of generality vs. specificity in per- 
sonality functioning. I think he is show- 
ing, for one thing, that the self-esteem 
measure is general, that a lot of little 
manifestations of self-esteem can be 
made the basis for a generalized picture. 
I am puzzled about whether his nonverbal 
measure is really more abstract. ( Here the 
subject indicates by means of a piece of 
apparatus, in one operation, what he re- 
gards as the discrepancy between his real 
self and his ideal self.) It turns out that 
the measure obtained in this way corre- 
lates with the self-ideal self discrepancy 
as revealed by Q sorts. What is most sig- 
nificant and highly interesting is that the 
measure correlates best of all with the dis- 
crepancy index based on items which the 
subject himself has chosen as important 
in human life. What I would like to ask 
Dr. Shlien is whether this nonverbal 
measure is really abstract or whether it is 
not simply another particular kind of re- 
sponse that the subject is asked to make, 
and whether it cannot be used as an index 
of a hypothetical generalized level of self- 
esteem. It seems to me that it might be 
regarded as another response, to be corre- 
lated with the total scale for measuring 
self-esteem. This raises the question of 
how stable the nonverbal measure is. If 
one took this measure from time to time 
during the course of a day, or a week, one 
might get a lot of variability. If this should 
turn out to be so, then one would be in- 
clined to doubt the value of the measure 
as an indicator of change in psycho- 
therapy. 

In my own thinking about self-esteem, 
which is a favorite variable, I have had to 
deal with another consideration, one that 
confronts us all in selecting variables: 
that is, how close to the objectively ob- 
servable do we insist that the variable be? 



How great is our willingness to entertain 
hypothetical constructs? My impression is 
that we don't worr} as much about opera- 
tional definitions today as we did 20 or 
25 years ago. Today we take a much more 
liberal view of the matter, nor insisting 
that everything be defined strictly in 
terms of operations. Operationism today 
means only that the hypothetical con- 
struct must be somehow related to some- 
thing that is observable. This is all that is 
really required. In the case of self-esteem, 
my inclination would be to regard it as a 
hypothetical construct, or as a central 
variable in the personality which shows 
itself in behavior in a great diversity of 
ways. On the other hand, one may look 
at variables as entities which are quite 
open to observation. I am willing to call 
these entities variables, but I would not 
suppose that they stand in any one-to-one 
relation to any subsystems of the per- 
sonality. I would prefer to reserve the 
term "variables of personality" for the 
hypothetical constructs that stand for 
processes inside the person, processes 
which may be expressed in different de- 
grees in various objective measures. 

Another thing that affects our choice 
of variables is preference in respect to 
methodology. Dr. Luborsky has offered the 
best example of "method-centering." Of 
28 variables that he could have used he 
chose 12, because they lent themselves to 
rating by the method of paired compari- 
sons. Well, we all do this sometimes; 
there are times when we have to use 
measures that are available. No doubt the 
variables actually rated have some theo- 
retical significance. But suppose Dr. Lu- 
borsky was forced to choose between 
variables that could be rated by this 
method of paired comparisons and vari- 
ables that on theoretical grounds were 
integral to the whole structure of per- 
sonality. I gather that he would be thrown 
into something of a quandary. Since I am 
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not doing research on psychotherapy I 
may announce that I stand foursquare for 
theoretical significance. Let the method- 
ologists devise methods that are adequate 
to genuine problems; and let us resist all 
pressures to use certain methods just be- 
cause they exist. 

Now let us return to the model shown 
in Figure 1. Typically in research on psy- 
chotherapy we focus on differences that 
turn up when we compare the person at 
the time of his entry into the change- 
system with himself at the time he leaves 
it. Often we attempt to assess him at later 
times also. I would call attention to the 
fact that the person is always being per- 
ceived and evaluated by other people his 
psychotherapist, his employer, his friends 
and relations and by himself. There is, 
of course, the truth about the person 
the person as he really is and this we 
seek to ascertain by scientific methods; 
but there is also truth in these perceptions 
and evaluations, and my suggestion is that 
we use these as criterion variables, bring- 
ing them in relation to predictor variables 
in the change-system and in the person at 
the time he enters it. 

Another suggestion: the whole process 
that extends from the time of a prelimi- 
nary interview to the time of follow-up 
some years after the person leaves the 
system is subject to division into numer- 
ous subprocesses and substages. Instead of 
trying to predict from the beginning to 
the end, let us concentrate upon, and study 
intensively, some of these subprocesses or 
substages. For example, we might test a 
prediction, made on theoretical grounds, 
that patients who in a preliminary inter- 
view exhibited traits a, b, and c would 
when confronted with activity t in an 
early stage of psychotherapy respond with 
behavior x. And so for any two times dur- 
ing the process of psychotherapy. And so, 
for that matter, for times after the therapy 
has been terminated. What we are after, 



it seems to me, is general knowledge 
about the conditions and processes of 
change in personality, knowledge that will 
be applicable not only to psychotherapy 
but to various other situations in which 
change is sought. To obtain this knowl- 
edge we should study change wherever it 
occurs and developmental change wher- 
ever it can be made to occur. This is quite 
a different objective from that of trying 
to show that psychotherapy does some 
good or that a particular brand of psycho- 
therapy has something to recommend it. 

A final point. In my view, investigation 
and activity designed to change or to de- 
velop people are not really separable in 
practice. It goes without saying that we 
can't change people deliberately without 
understanding them. Or more precisely, 
our understanding and changing activities 
go on together. We learn enough about 
a person so that we believe a certain in- 
tervention by us might induce a desired 
change. Then we try and see. When due 
attention is given to the rules of evidence, 
there is probably no better way to increase 
our understanding of people than through 
the practice of psychotherapy and of 
other techniques of planned change. What 
is perhaps not so well understood is that 
the study of people over time just study- 
ing them without any other kind of inter- 
vention is very likely to change them. 
This was our experience at Vassar College. 
It was our distinct impression that inter- 
viewing students, doing nothing but ask- 
ing them questions, several times a year 
over a period of four years had the same 
kind of general effect as does counseling 
or psychotherapy. This means that the 
investigator who proposes to look deeply 
into the processes of his subjects must 
take the same kind of responsibility as 
does the psychotherapist or the educator. 
This brings us back to the question of 
value that was debated, with feeling, this 
morning. My position is that as psycho- 
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therapists, or teachers, or parents, or psy- 
chological investigators we cannot avoid 
responsibility for changing people. This 
means that we must work within a system 
of values implicitly or explicitly. The 
only way to promote good effects and to 
avoid harmful ones as judged according 
to the system of values is to know 
enough about the conditions and mechan- 



isms of change so that we can predict the 
effects of each particular action. 
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DR. HUNT. I want to give the dis- 
cussed authors a chance to respond to the 
discussant. Dr. Lorr says he has no com- 
ments to make, so I will give you Dr. 
Luborsky. 

DR. LUBORSKY: I'm indebted to 
you, Dr. Sanford, for your discussion. I 
would like you to carry it further; in par- 
ticular, I'd like to hear more of your re- 
action to the main correlations that are 
presented in the paper for example, the 
one about the relationship of anxiety to 
my change measure. I would like to hear 
your interpretation of the correlation. As 
you could tell from the paper, it certainly 
struck my fancy when it turned out that 
way. It generated a number of ideas as to 
how one would go further in understand- 
ing the correlation. 

You noted the relationship of our vari- 
ables to the psychoanalytic theory. I would 
say we were liberal in choosing these vari- 
ables, for we did not systematically or 
solely derive these variables from psycho- 
analytic theory. The variables came from 
psychoanalytic theory plus experience 
with a variety of psychotherapies. 

About the selection of only 12 variables 
for paired comparisons: Every method re- 
quires selection from the data. As I men- 
tioned in the paper, we did not stop mak- 
ing assessments of all variables. Future 
analyses of data by other methods will 
supplement the paired comparisons. 

DR. SHLIEN: There was one question 
about the meaning of "abstract." I used 
it as referring to something which can 
be conceptualized, and which can be 
raised above the level of specific content. 
Without those two qualities, it does not 



deserve to be called a general personality 
variable. There are many kinds of con- 
crete statements in our personality inven- 
tories which are nothing but complaints 
no more personality variables than "beats 
his wife" or "speeding through red light" 
found on the police blotter. They are just 
the culture's complaints against the in- 
dividual. Then there are individual con- 
cretes which are unique, and they are not 
personality variables either. But they are 
the content of an abstract statement which 
could be a personality variable. A per- 
sonality variable which can be raised to a 
high level of abstraction isn't so much a 
dependent consequence as it is a prime 
mover which will be projected upon all 
sorts of testing situations. There is a study 
by Levy 1 in which he asked some subjects 
to describe an ideal home town and their 
own home town and also an actual self 
and ideal self. In each set of descriptions 
he had a self (or actual) and ideal corre- 
lation. The correlation between these two 
actual ideal correlations was quite high 
(-[-.75 or so), which sounds to me as if 
this demonstrates a real, abstract person- 
ality variable, expressing itself in terms of 
self perception, or town perception, or 
other possible concretes. 

DR. FRANK: This is what I thought 
would explain your results, but how does 
this explain the fact that the most ab- 
stract correlates more highly with the 
most concrete Q sort? I should think it 
would correlate equally with the less 
specific Q sort. 

1 Levy, L. H. The meaning and generality 
of perceived actual-ideal discrepancies. /. con- 
sult. PsycboL, 1956, 20, 396-398. 
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DR. SHLIEN: Well, ir seems to me 
that in a way that is a play on words, 
which is most concrete. I think the mean- 
ingful concrete is the concrete for each in- 
dividual and those concretes which we 
generally use "Does your stomach rum- 
ble?" or "Do you want to be a florist?" 
and that sort of thing these have a lot of 
error variance in them. They don't mean 
very much to me personally. That is how 
I would explain the difference. 

DR. FRANK: If the tendency is to 
put a certain distance between the real 
and the ideal in a personality trait, why 
shouldn't it apply to all three of these test 
situations? 

DR. SHLIEN: Well, it isn't as easily 
projected upon concretes which are mal- 
adjusted to that person. 

DR. BETZ: I like Dr. Shlien's paper 
very much. It recalled to my mind Alfred 
North Whitehead's discussion of "gener- 
alities" and "particulars" that certain 
particulars carry within them an entire 
generality. This has been thought-provok- 
ing to me as a physician conversing with 
patients, because global, theoretical con- 
ceptions often don't lend themselves to 
lively conversational interchange. But 
neither do trivial particulars. If the right 
"particular" can be found some current 
experience on the ward, for example 
that contains within it a basic "generality" 
(theme or issue) of that patient's diffi- 
culty, it can be effectively utilized for a 
discussion that is particular, but not trivial 
that has larger overtones. If such a 
particular can be successfully utilized, the 
general problem frequently resolves it- 
self. It is of help in carrying on meaning- 
ful conversations with schizophrenic pa- 
dents if the doctor can recognize a gen- 
erality in a particular. To me, Dr. Shlien's 
work demonstrates the possibility that 
:here may be ways to approach generality 
ind "meaning" directly, rather than just 
Dy inference from collections of separate 
items or traits. 



DR. SANFORD: We might as well go 
on with this. It seems to me that all per- 
sonality traits are abstract; anything that 
we infer as a more or less durable dis- 
position in the person is abstract, and I 
don't know just how to define degrees of 
abstractness. Nearly all of these traits that 
we mentioned are highly abstract con- 
cepts, but your conception, Dr. Shlien, 
makes me think not so much in terms of 
abstractness vs. concreteness as in terms 
of centrality vs. superficiality or inward- 
ness vs. outwardness. It seems to me that 
what you are saying is that the nonvariable 
measure gets at a more inward aspect of 
the person, inward in the sense that it is 
less dependent on immediate field condi- 
tions than would be some of these particu- 
lar things that you are calling concrete. 
The "rumbling of the stomach" and that 
sort of thing would be pretty closely re- 
lated to a very concrete and tangible ex- 
perience; and I thought that the reason 
the nonvariable measure went with the 
more idiographic picture was just because 
the person was giving in this picture 
something a little more inward and dur- 
able, a more characteristic part of his 
unique self; and that you gauged this 
more directly by means of the nonvariable 
measure. It seems to me that this is an 
inward-outward dimension rather than an 
abstract-concrete one. 

DR. BORDIN: I would put it in terms 
of specificity generality. That seems to be 
the issue rather than abstract concrete. 
The question might be put this way; how 
heterogeneous is the domain of responses 
that is being sampled in which you are 
finding a high interrelationship? Ideally 
you would want to hit on a concept that 
will have the maximum generality in a 
most heterogeneous domain of responses. 
I had the feeling that Dr. Sanford's re- 
sponses earlier this morning were raising 
one of these issues. In fact, how hetero- 
geneous was your domain of responses 
that you were observing? It strikes me 
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that there was not as much heterogeneity 
as I would like to see, in the sense that 
all measures represent a task where the 
individual is to describe himself via 
words, via manipulating some object, or 
something of this sort. How homogeneous 
or heterogeneous you consider this domain 
depends partly on how you define the 
domain. I define all of these tasks as fall- 
ing into the class of conscious self- 
description. To make the domain more 
heterogeneous, we ought to have situa- 
tions in which the task given him is not 
to describe himself, but where his be- 
havior would offer an opportunity to infer 
how he is seeing himself in terms of ideal 
versus actual. 

DR. SHLIEN: Don't you think I just 
gave you an example of that? in Levy's 
study in which he asked people to describe 
an ideal town or their own home town. 

DR. BORDIN: Well, as soon as you 
start putting it into ideal or actual I have 
some concern here. 

DR. HUNT: Is this concern between 
self -acceptance and self -comfort, is it be- 
tween the nature of these items in the 
general issue? 

DR. BORDIN: Well, for example, if 
you ask someone to describe his patients, 
isn't he describing a part of himself? So 
if you study how he talks, how he would 
like his patients to be and how they ac- 
tually are, don't you expect that under 
those circumstances you are getting partly 
a description of how he sees himself? This 
is what would make me a little uncom- 
fortable, that such observations are not 
far enough removed from the observation 
situation where the individual sets out to 
describe himself to someone else. I would 
like to get as far away as possible from 
that situation. I would admit that describ- 
ing one's town is not identical with de- 
scribing oneself, but it seems to run the 
risk of partaking too much of the initial 
situation where you ask the individual 
directly to describe himself. 



DR. SANFORD: It is very helpful to 
me. I explored this a little bit this morn- 
ing, this generality vs. specificity thing, 
and I think it is helpful. To me it seems 
very much like the old issue that Gordon 
Allport discussed at length some years 
ago. Consider honesty, for example. The 
reason that we are interested in general- 
ized honesty is because this would permit 
us to predict individual behavior in a 
great diversity of situations. It would be 
a dependable feature of the person in 
that sense, if indeed such a trait exists. 
Nowadays we are more willing than for- 
merly to agree that such generality exists, 
but the issue is still alive. It is very in- 
teresting to have it revived in this way. 
If we use honesty as an example, it seems 
to me that what you would be doing, Dr. 
Shlien, is finding a particular response 
that somehow partakes of the totality of 
honesty. To go back to self-esteem, the 
empirical question is whether the self- 
esteem that you get at by means of a non- 
variable procedure really is general in the 
usual sense of the word; can we depend 
upon it to predict high level self-esteem 
responses in a great diversity of future 
situations? 

DR. SHLIEN: I think a single self- 
esteem measure probably is dependable. 
That is the significance of this study, and 
it is a probable model for other measures. 
Let me point out also that what I am 
trying to say here is that the aims of the 
researcher will determine to a large extent 
what level of abstraction he uses. If I only 
wanted to compare Adlerian and dient- 
centered outcomes, I could just as well 
have used this highly abstract self-ideal 
apparatus. But if one wants to know also 
about differences within subgroups of 
those two populations, one needs a set of 
descriptions at a lower level of abstrac- 
tion. This is something we want, so Dr. 
Butler and I are working on a factor 
analysis of the arrays of concrete items 
from which we drew this abstract over-all 
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measure of self-esteem. There you see the 
effect of the researchers' aims upon the 
level of abstraction we choose for meas- 
urement. 

DR. BUTLER: This seems to me to be 
an important issue, important enough for 
me to register a dissent on this. I think 
Dr. Shlien is right, not because he is a 
colleague who is close to me, but because 
he is right. It is a real abstractive process. 
My first guess is that they were overjoyed 
to find so much consistency in situations 
so different. 

My second reaction is that we should 
consider the nature of the abstractive 
process in relation to the conditions under 
which the abstractions or generalizations 
arose. If a person says "I am inferior," it 
is a high level of abstraction, although it 
may be a trait. There are then specific 
situations, "concretes," as Dr. Shlien calls 
them, specific sets of experiences, leading 
to the generalization "I am inferior," or 
something like that. In varying degrees 
we think that this is a core abstraction or 
a guiding abstraction, which governs be- 
havior and therefore is very important. I 
think we should consider the conditions 
which brought about the self-description 
and the ideal description of the person. 
Whatever they were, they had little to do 
with a piece of plexiglass apparatus. The 
fact is that the self -ideal description in 
terms of traits and the self-ideal descrip- 
tion in terms of overlap of pieces of 
plastic labeled self and ideal were related. 
It seems to me, therefore, that the direc- 
tion of generalization runs from specific 
experiences in specific situations to the 
linguistic self and ideal descriptions to 
the self and ideal descriptions symbolized 
by the overlap between plates of plexi- 
glass. How otherwise is a person able to 
fit these pieces of glass together in a 
meaningful way? The same thing holds, 
I think, for the relation between self -ideal 
descriptions and actual home town w. 
ideal home town relations. It seems, on 



these grounds, that Dr. Shlien's usage 
meets the criteria of people studying 
generalization. 

DR. BLOCK: I think it is a distressing 
property of this field that different people 
can interpret the same data not orthog- 
onally but diametrically. As I recall the 
Levy study, precisely the opposite point 
was made; namely, here was an artificial 
and deliberately distant measure that 
correlated too highly with self-ideal cor- 
respondence, thereby attenuating the 
meaning to be ascribed to the self-ideal 
measure. In reading Dr. Shlien's paper, I 
kept feeling, as I read about the plexiglass 
and the superimposition of the panes of 
glass to get a percent of variance, etc., that 
while the measures were becoming more 
and more abstract and divorced from spe- 
cific procedural details, the measures were 
also becoming less important. It seems to 
me that in showing self -ideal correspond- 
ence as measured by the angle between 
two panes of plexiglass relates to self- 
ideal self correspondence as measured by 
Q sorts, one shows that Q sort measured 
self-ideal self correspondence means less 
than we had hoped it might mean. The 
findings of generality as measured in these 
several ways can be extended even further 
so that the measure could be derived 
simply by asking people to place them- 
selves on a seven-point scale "How do 
you like yourself today?" The question 
then becomes "So what will these findings 
of generality mean?" My own feeling is 
that such findings of generality suggesting 
self -ideal self correspondence per se has a 
rather limited and superficial meaning un- 
less it is connected to other measures or 
placed in a context of understanding. Self- 
ideal self correspondence has a signifi- 
cance only after confounding variables are 
partialed out variables such as defensive- 
ness or tendency to create a favorable im- 
pression in the person who will be looking 
at the protocols, and so on. Unless this is 
done, it seems to me that the demonstra- 
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tion of a correspondence among several 
uncorrected self-ideal self correspondence 
measures does not imply support for an 
abstraction or construct of importance. 

DR. SHUEN: I think as you take a 
measure which you can abstract at higher 
and higher levels you really demonstrate 
its importance rather than its unimpor- 
tance. I feel that just as you would not 
want simply to treat symptoms, why sim- 
ply measure symptoms? 

DR. LUBORSKY: I wonder for what 
types of problems your abstraction prin- 
ciple is important? The paper itself does 
not clarify this. In the first few pages 
there is a discussion of contradiction 
among various criteria. The rest of the 
paper is on self-ideal ratio as a criterion. 
The discussion never does come back to 
the relationship of this criterion to the 
other criteria, so that the title really should 
be: "Toward what level of abstraction in 
self-ideal ratio as a criterion?" That is the 
main thing considered. You are not com- 
paring the self -ideal ratio's level of ab- 
straction with the level of abstraction of 
other criteria in psychotherapy, so that we 
do not really have a basis for answering 
"toward what level of abstraction in a 
criterion." It does tell us interesting things 
about the generality vs. specificity of the 
concept of self-ideal. Your data tell us 
that people will show the same behavior 
on this variable no matter how you ask 
them the question. 

The finding reminds me of a story 
about a man who came to a wise old man 
(whose role has fallen upon present day 
therapists) and wanted to know how he 
would fare if he went across the border 
and lived in another country. The sage 
asked him, "How was it in the country 
from which you came?" And the man re- 
plied, "I had a hard time there." The sage 
then answered, "Well, that's the way life 
is in the other country too." 

DR. SHLIEN: I am only putting that 



forward as a model, and I am suggesting 
that this same kind of analysis could and 
should be applied to other personality 
variables. 

DR. SANFORD: I believe you said, 
Dr. Shlien, that this might be applied to 
variable ideal strengths. Wasn't that one 
of the possibilities? This brings us to one 
of the issues now on the floor. I think 
probably you're accenting experience- 
phenomenology. That makes some sense 
to me. The feeling about oneself in rela- 
tion to one's ideals could be a broad 
phenomenal field. It could be described 
in holistic terms; and you are suggesting 
that you can get at this total field in this 
way perhaps much better than you can by 
befogging the issue of self vs. ideal and 
all these variable constituent concepts. A 
concept like ego strength makes no refer- 
ence to the phenomenal field at all. It is 
simply a concept designed to order an 
enormous diversity of observed events. I 
might say, half facetiously, that you might 
walk up to the person and ask, "How is 
your self-idealself ratio today? How is 
your morale today?" But you wouldn't 
walk up to a person and ask, "How is your 
ego strength today?" Or if you did, you 
wouldn't be approaching what the people 
who invented this concept mean by it. 
On the other hand, if you define self- 
esteem in phenomenal terms, you could 
make some sense of asking people in 
some more or less direct way how they are 
phenomenally. 

DR. HUNT: Are you differentiating 
trait and state in a sense, trait being en- 
during and state being momentary? 

DR. SANFORD: I think it is like that, 
and I think this is connected with my 
question about the stability of self-esteem. 
It would seem to me highly variable, par- 
ticularly in young people, who are so 
readily plunged into the depths by failure 
and elevated to great heights by momen- 
tary success. 
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DR. BETZ: Could this be used as an 
instrument like a thermometer by which 
one might gauge the variability of self- 
esteem within a certain range for certain 
people? There might be a range like nor- 
mal temperature, and then there might be 
ranges outside of that 

DR. SANFORD: It seems to me it 
would be wonderful for getting rapid 
soundings during the course of an enter- 
prise, for possible fluctuations during such 
an undertaking. 

DR. ROSEN: Aren't there many dif- 
ferent and equally appropriate levels of 
abstraction, depending on the question 
"Appropriate for what?" The level of ab- 
straction on which one talks with a pa- 
tient during a psychotherapy hour is some- 
what different, I think, than the level of 
abstraction on which one discusses a case 
perhaps with one's supervisor or with 
one's colleagues, which again may be 
different from the level of abstraction on 
which one discusses a particular phe- 
nomenon when one attempts to do re- 
search and discuss it at a conference. 

DR. BUTLER: I hope you will fore- 
bear another comment by me. I am some- 
what ego involved in this question because 
I began pushing self-ideal comparisons 
about 1947 (when I joined Rogers and 
colleagues) on the basis of a description 
of L. Sweet's work in 1931 by Percival 
Symonds; and I think there are experi- 
mental, factual results which bear on 
these questions. 

In the first place, as we follow success- 
ful cases through therapy and establish 
criteria we find that self-ideal correlations 
on Q sorts increase for those cases labeled 
successful, by and large. By and large for 
those cases labeled unsuccessful on the 
basis of many criteria, the self-ideal corre- 
lations tend to decrease or remain at the 
pretherapy level. Now, that is one thing. 
Experimentally this has been criticized be- 
cause of the possible fact that the content 
of the Q sort is the same thing as what is 



talked about in therapy. The cards may 
not look like what the therapist and the 
client or patient are talking about, but 
they may be topics which may have been 
touched upon. Now, if you take another 
operation entirely, for example, the plexi- 
glass apparatus, therapist and client were 
not talking about putting spheres to- 
gether, and substitute that for a Q sort, 
then you have avoided that criticism, and 
I think this is a worthwhile experimental 
point. It is a different kind of behavior 
rather than a similar kind of reaction to 
verbal stimuli from cards and verbal in- 
terchanges in a therapy situation. I think 
from this point of view the finding that 
self-ideal correlations are consistent over 
a rather wide range of different behav- 
iorial situations, different kinds of reac- 
tion with the environment, is quite in- 
teresting. So far you have been only able 
to get at self -ideal by verbal means. Now 
we find this kind of consistency which 
allows us to substitute one kind of task 
for a distinctively different kind of task. 
It opens up possibilities for studies which 
simply have not been available before. 

DR. FRANK: I am still troubled about 
one thing here. You are assuming that 
this is a function of the thing that is being 
judged, that is, the reality versus the ideal. 
Suppose people have a constant discrep- 
ancy for any two judgments when neither 
one is anchored. Suppose you ask what is 
the difference between an angel and an 
archangel, for example. Would some peo- 
ple show bigger discrepancies, and some 
smaller discrepancies? Is there any way 
of trying to test this out? 

DR. SHLIEN: No. Somebody men- 
tioned that before. That is a curiosity. 
That is a good question. 

DR. FRANK: What you are measur- 
ing may be the habitual tendency to see a 
certain amount of difference between two 
things, neither of which is anchored. 

DR. SIEGAL: We know that people 
have response sets in the way that they 
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answer rating scales. There are people 
who are willing to use scale extremes and 
some who stick to the innocuous middle. 

DR. SHLIEN: Well, then, it appears 
that this means something. 

DR. FRANK: It does mean something. 
It may be something entirely different 
than a statement about the ideal and real 
Q sorts. 

DR. BORDIN: I would feel better 
about it if one could do it that way. I 
don't seem to have gotten part of my 
message across, at least I don't think to 
Dr. Butler, because most of the time when 
he is talking, he speaks of specificity- 
generality of a communication. Another 
issue is the mode of communication. 
There are different ways you can com- 
municate a message. You can communi- 
cate it in verbal terms. You can say, "I 
think your ideas are all wet," or you can 
just go (gestures with hand). One has 
been with words, and one has been with 
action. Is this general or specific? The 
lack of generality lies in the content. The 
lack of generality in these situations, no 
matter what the form of communication, 
is that you are asking the person to say 
something about himself that involves a 
concept of an ideal and a concept of how 
he actually is. This is the lack of generality 
that exists in all of these situations. Al- 
though some of them involve words and 
some of them involve plexiglass, they all 
have in common that you are saying to 
the subject, "Respond to me, do some- 
thing," in these terms of communication, 
"that tells me something about how you 
see your ideal self, how you see your ac- 
tual self." 

DR. SHLIEN: One thing I get out of 
your message is that you are in favor of a 
high level of generality in behavior. Is 
that true? 

DR. BORDIN: This comes back to the 
other issue of "for what" I have a differ- 
ent view of it, I think, than Dr. Luborsky 



has. I think that the "gang" at Chicago 
has offered certain specifications with re- 
gard to the discrepancy between ideal and 
actual views of oneself. Rogers has offered 
certain specifications about how one's re- 
sponse to oneself in ideal and actual terms 
is influenced by the responses of care- 
takers during childhood. I am shifting on 
the other side and defending the concept 
as such. But there is the necessity of mov- 
ing beyond and we were talking about 
this before making lots more specifica- 
tions about the nature of this as a person- 
ality variable. 

DR. BLOCK: I thought the Levy study 
has been relevant to this discussion more 
than a little, and I think it is pertinent to 
introduce still other data in the field. First 
note that since by and large the ideal 
selves of individuals seem to be pretty 
similar, the great proportion of the vari- 
ance of self -ideal self-congruency measures 
is ascribable to diff erences in the self- 
pictures people offer of themselves. There 
is a lot of information on self -descriptions 
and the correlates of self -description. For 
example, in experiments on social percep- 
tion, it is found time and again that peo- 
ple who describe themselves favorably 
(and who therefore will have a high 
correspondence between self and ideal) 
also will describe other people favorably 
whether they know them or not. These 
ascribers of unqualifiedly favorable char- 
acteristics themselves have unfortunate 
personal qualities and they make less dis- 
criminations in social perception experi- 
ments than people who are taking chances 
in their predictions. There are many other 
such findings related to self-descriptions 
which should be brought to bear upon an 
understanding of self-ideal self corre- 
spondence measures. The significance of 
these results is this: to use self -ideal corre- 
spondence as an operational translation of 
the self concept, one has to qualify the 
measure or handle it quite carefully. I 
don't think the arguments so far question 
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the usefulness of the concept of self. The 
notion organizes many facets of the indi- 
vidual and relates to his behavior in some 
fairly intricate, yet specifiable ways. I 
think the problem before us is that the 
particular ways of measuring self -ideal 
self correspondence, although different, 
are all frankly rather patent. We need to 
become more sophisticated so as to get at 
and control some of the unfortunate in- 
fluences upon the self-ideal self discrep- 
ancy, thereby making this index a more 
faithful reflection of the underlying 
concept. 

DR. GORHAM: One of the difficulties 
of using actual-ideal Q sorts as a measure 
of psychotherapeutic change is the con- 
founding influence of the therapist. In- 
crease in actual-ideal correlations may 
represent progress to some therapists, 
while the same change indicates increas- 
ing of unhealthy rigidity to others. The 
direction in which the therapist is trying 
to lead the patient is probably related in 
some way to the degree of his own per- 
sonal actual-ideal ratio. 

DR. BETZ: Could this instrument not 
be used on the therapist as well as on the 
patient? 

DR. GORHAM: This is exactly what 
is being done by the Rogerian group. So 
far so good. However, it is assumed by 
them that if the patient ideal is approach- 
ing that of the therapist, improvement is 
taking place. 

DR. SHLIEN: Well, the assumption is 
that self -ideal ratio is a measure of self- 
esteem. If you want to argue now that 
self-esteem is not the significant variable, 
do so. 

DR. GORHAM: Indeed, I think it is 
a very significant variable. It seems to be 
misinterpreted here, because what means 
self-esteem to some means rigidity or per- 
fectionism to others. 

DR. SHLIEN: We do know about 
that; we know that there are defensive 



sorts which are unreasonably high and 
that sort of thing, but those are technical 
questions about the meanings of different 
levels of self-ideal correlations. The kind 
of question that I am really trying to 
speak to is the kind of question raised by 
Dr. Rosen who says there are different 
levels of abstraction and which one do 
you want to apply to which part of the 
conduct. My feeling is that though you 
may in your therapeutic sessions talk at 
a low level of abstraction, you are really 
trying to work toward a more general out- 
come, that is to say, when the patient says, 
"Gee, I wish I had enough guts to talk 
back to my teacher," I think if you were 
just accepting this statement at face value, 
you would really be dealing with the level 
of symptom reduction. I don't think that 
is what any therapist wants to do. I think 
you really want this person to turn out to 
be a generally courageous person. If that 
is what he wants, then why isn't the meas- 
ure "courage" a properly higher level of 
abstraction? 

DR. SANFORD: I have one further 
comment about self-esteem. One of the 
biggest differences we found at Vassar be- 
tween the seniors and freshmen was that 
the seniors had a much higher ideal self/ 
self ratio, that is to say, the opinion of the 
self, the real self, was much lower than the 
ideal, whereas in freshmen there was a 
great similarity between the two estimates. 
One could put this down to the greater 
sophistication of the seniors, their greater 
willingness or inclination to admit un- 
favorable things about themselves, or per- 
haps some inclination even to be ironical 
about themselves, to make wry comments 
about what they are and what they would 
like to be, whereas, the freshmen showed 
more uniformity in all of these apprecia- 
tions. For the freshmen the real self was 
more like the ideal woman and the ideal 
self was more like the average woman. 
Now, we may raise the question, Which 
of these groups of people, freshmen or 
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seniors, had the higher health-sickness 
ratio? The low ideal self/self ratio, of 
course, was one of the numerous signs that 
the seniors were less healthy in some sense 
of the word than the freshmen. I think, 
then, that in a way we are talking here 
about different conceptions of the aims of 
therapy or different conceptions of desired 
states. Our impression was that the fresh- 
men were more healthy. They were more 
harmonious internally; life was somewhat 
simpler for them. They saw themselves in 
a fairly clear way; they saw where they 
had been, where they were going, whereas 
the seniors were definitely more upset, 
confused, disrupted, in conflict. But we 
were not too disturbed about this because 
we thought that these were signs of 
growth in the seniors. Growth is a suc- 
cession of upsets and integrations at 
higher levels. Eventually, probably, the 
seniors will achieve stability. But if it is 
stability we are after, one can see the role 
of this sense of all-of-a-piece-ness, of har- 
mony and comfort about oneself; but if 
one is thinking of the personalities mov- 
ing in the direction of greater complexity, 
which would naturally bring more dis- 
harmony, then his aim is somewhat dif- 
ferent, and the ideal self/self ratio has a 
different implication. 

DR. BORDIN: Did you have social 
desirability measures on your groups of 
freshmen and seniors? You had given 
them MMPIs, hadn't you? 

DR. SANFORD: Yes. 

DR. BORDIN: And did they differ 
on that? 

DR. SANFORD: In the same way. 

DR. BORDIN: In the same way. It 
seems to me that this is important because 
the social desirability measure could be 
interpreted as a situational relevant meas- 
ure, the person's willingness to respond 
in a conventional way. This is one way to 
interpret it I am not sure I would be 
willing to argue that it is the only deter- 



minant of the measure. But, to the extent 
that it reflects that, then the question 
enters of the situational factor in this 
ideal-self relationship. 

DR. STRUPP: What Dr. Shlien's 
demonstration and much of the research 
as well as a good deal of the discussion 
indicates to me is that there is consider- 
able unclarity about the precise meaning 
of the self-ideal correlation, as indeed 
there is much question as to what the 
correlations in Q methodology mean any- 
way. We seem to be dealing here with a 
highly general and very vague factor 
which has some construct validity at 
least in client-centered therapy and 
which correlates with favorable outcomes 
of therapy and similar measures. But, I 
think we are as yet far from understand- 
ing what this correlation means. Dr. 
Shlien's demonstration in fact lends cre- 
dence to my assertion that we do not 
precisely understand what this correlation 
indicates. It is interesting that as far as I 
know this measure has not been tried in 
other forms of psychotherapy. It may be 
indicative of a general sense of well-being 
or, contrariwise, of malaise or moroseness, 
but what it means beyond that is largely 
guesswork. 

DR. LUBORSKY: My comments are 
on the meaning of the self-ideal discrep- 
ancy. They relate partly to Dr. Lorr's 
paper. He reports that patients who re- 
mained in treatment (at the eight-month 
point) had higher manifest anxiety and 
less favorable self-descriptions than pa- 
tients who did not remain. These two 
qualities may belong together. Several in- 
vestigators, including Rogers, have con- 
cluded that the self-ideal gap implies dis- 
equilibrium so that people with a large 
self-ideal gap should show anxiety. I 
would expect this to be true, by and large, 
in the college seniors described by Dr. 
Sanford. Facing the future after gradua- 
tion engenders self-questioning and there- 
fore also anxiety. I am saying in total that 
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a high self -ideal gap may imply a readi- 
ness for anxiety and possibly also, there- 
fore, a readiness for change I think that 
ties in with the point that Dr. Siegal and 
I both make in our papers. 

DR. SHLIEN: May I say one more 
thing? It seems to me that the questions 
that Dr. Saslow raises about comparability 
and that Dr. Strupp raises about the im- 
provised means of self -ideal correlation 
could be applied to all other kinds of 
criteria we used. It troubles me a little to 
think that self-esteem has been just a little 
the property of the Counseling Center or 
that we alone take a precious attitude to- 
ward self-ideal correlations, and that sort 
of thing. I feel personally that the kind 
of problem the paper raises is your prob- 
lem as well as our own and applies to all 
of your criteria as well as our own. 

DR. HUNT: I think I am going to call 
a halt on this discussion. All right, Dr. 
Luborsky on Dr. Lorr's paper. 

DR. LUBORSKY: I believe that Dr. 
Lorr's study is the best designed one in 
the psychotherapy literature dealing with 
frequency of appointments in relation to 
change. It attempts to control for the 
selection of patients, and the comparison 
of initially equally "sick" patient groups. 
I was therefore quite interested in the 
results, for they bear on a prevalent prac- 
tical problem, 

Dr. Lorr qualifies his results as -applica- 
ble to the patient population he studied, 
which is a blessing in any paper. I say this 
because I suspect in his patient group, 
which is part of the outpatient VA clinic 
population, that if we applied the Health- 
Sickness Rating Scale, we would not find 
the entire range of patient population in- 
cluded. Probably relatively few patients 
who would be acceptable for psycho- 
analysis were represented. The heaviest 
concentration may have been in the 
"borderline psychotic" range. The rela- 
tionship of frequency of appointments to 
change differs for patients who are at dif- 



fent levels of what we call "mental 
health." Also, some treatment structures 
may work best at a certain frequency of 
appointments, e.g., four to five hours per 
week is supposed to be optimal for psy- 
choanalysis; for sicker patients, we often 
suggest supportive therapy with relatively 
infrequent appointments over a long time 
span. 

How do you explain the fact that 31 
patients (out of 133) didn't respond to 
the follow-up request? For patients who 
have completed a period of psychotherapy, 
this seems to be a high percentage. When- 
ever the percentage is so high one must 
suspect a selective factor and possibly 
one that operates beyond the reach of the 
available information you have about 
these patients. 

DR. LORR: On the matter of which 
patients remain, a distinction should be 
made between those who terminate pre- 
maturely and those who remain about six 
weeks or longer. Our studies as well as all 
I have seen in the literature indicate that 
the patient who terminates prematurely 
without or against the advice of the thera- 
pist is strikingly different from the pa- 
tient who does not quit treatment. The 
former is less anxious, more psychopathic 
and nomadic, more ethnocentric, less dis- 
satisfied, and less well educated than the 
typical remainer. 

Of the cases lost from the study at the 
end of eight months, some had completed 
or terminated treatment, and others who 
remained in psychotherapy were excluded 
because their treatment frequency had 
been altered by the therapist. The pre- 
treatment status of patients remaining in 
the study at eight months at assigned 
treatment schedules differed from the pa- 
tients who dropped out. The eight-month 
sample was seen as more disturbed and 
Manifest Anxiety scores were higher. 
Thus the eight-month sample was not 
quite the same as the sample at the end 
of four months. 
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We are quite conscious of the fact that 
our patients are chronically ill and some 
have been in psychotherapy before. We 
would be reluctant to generalize to groups 
not similar to them. 

DR, SANFORD: Dr. Luborsky was 
asking earlier for some response to the 
substance of his paper. (I wasn't able to 
summarize the papers in my discussion 
earlier, for which I apologize.) He was 
calling attention to the major finding that 
of the numerous variables assessed at in- 
take, anxiety level was about the only one 
that really correlated with the posttherapy 
assessment of improvement. The correla- 
tion was .44, I believe. Then at the end 
he came to what I think he regards as the 
really important point, which is that the 
best outcomes were achieved by patients 
who at the beginning were high on 
"good development" or something of that 
kind, and who also had a high anxiety 
level. This, I think, is what Dr. Luborsky 
is most interested in. It is the suggestion 
that anxiety may be a good thing. It is a 
particularly good sign of a favorable out- 
come if it is occurring in a person who 
doesn't need therapy very much. Aside 
from this, Dr. Luborsky addresses himself 
to a major hypothesis: that people who 
do best in therapy are generally those who 
need it the least, that is, those people who 
are already most well developed are those 
who will go further. And also he is saying 
that if these people have some anxiety at 
the same time, then the prospects for a 
good outcome are particularly good. This 
makes a lot of sense. Now, Dr. Luborsky 
has brought this into relation with self- 
esteem and also into relation with the fre- 
quency of the therapy sessions; this leads 
me to say one thing about Dr. Lorr's 
paper. His finding on frequency of ses- 
sions is one of the few things that has 
ever come out of psychotherapy research 
that seems to me very useful to the prac- 
titioner. But we have to be very careful 
about this. I don't believe Dr. Lorr's find- 



ing suggests that we ought to adopt as a 
general rule some given frequency of 
sessions for all patients. I know Dr. Lorr 
doesn't believe this either. Actually, the 
frequency of sessions in practice, I believe, 
has a lot to do with the therapist's assess- 
ment of the anxiety level. If a patient is 
having a bad time and is having a lot of 
anxiety, the natural recourse is to frequent 
sessions. 

DR. HUNT: Or the opposite. I wonder 
if this is possible. 

DR. SANFORD: Unless you can 
quickly reduce the anxiety; in which case, 
according to Dr. Luborsky, you reduce 
your chances of therapeutic gain. 

DR. HUNT: My point was that if you 
are really getting into this, the more inter- 
views you have, the more likely the anx- 
iety is to pile up. 

DR. SANFORD: Well, much depends 
on what the therapist is doing. I think he 
usually has in his armamentarium some 
means for generating anxiety and some 
means for reducing anxiety. He uses these 
in accordance with his conception of what 
the traffic will bear. I think that frequency 
of sessions cannot follow a rigid rule, but 
it is something to be adapted to general 
circumstances as the therapist understands 
them. 

DR. LUBORSKY: There are many un- 
answered questions about frequency of 
sessions. One concerns the consequences 
of very frequent vs. infrequent appoint- 
ments. A study should compare three or 
more with two or less appointments per 
week. I would think this would be impor- 
tant to help us to reach broader applica- 
tion of the research results. 

DR. STRUPP: This finding of Dr. 
Luborsky's, that anxiety is significantly 
correlated with and highly predictive of 
outcome, is rather startling, because it 
runs counter to what has been reported 
in the literature about the relationships 
between judgments of the patient's suita- 
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bility for psychotherapy and outcome. In 
one of our studies, 2 anxiety was very un- 
reliably correlated with suitability for 
therapy and expected outcome, as judged 
by a psychiatrist. This leads me to wonder 
whether anxiety in the Menninger study 
was not in turn correlated with judgments 
about the patient's motivation for psycho- 
therapy. Partly, the correlation may be due 
to the fact that patients had been selected 
who were considered highly motivated for 
therapy. The findings of other studies may 
be different because very different patient 
populations were involved. I would ap- 
preciate your comment on this point. 

DR. SIEGAL: May I just make a re- 
mark. I think it is much too simple to say 
that Dr. Luborsky's study shows that 
anxiety is a good thing across the board. 
I think that what this study shows and 
what our study shows is that judging from 
anxiety alone you don't know where you 
stand. You have to know in whom the 
anxiety is occurring. I think all of us know 
this clinically. It's very different if you 
have a neurotic patient who is anxious 
and you are going to analyze him. That is 
quite different than having a very dis- 
organized psychotic patient who is 
anxious. I wouldn't just let it go by saying 
that a correlation of .44 between initial 
anxiety level and degree of change after 
treatment means, across the board, that 
anxiety is a good thing. 

DR. LUBORSKY: We had examples 
of those extremes. 

DR. SIEGAL: Yes. 

DR. ROSEN: That is the point I 
wanted to ask Dr. Strupp about. Was your 
correlation an across-the-board one per- 
taining to all patients. I think that Dr. 
Luborsky's finding had to do with anxiety 
in patients with a certain degree of ego- 
autonomy. The presence of anxiety proved 

2 Strupp, H. H., & Williams, Joan V. Some 
determinants of clinical evaluations of different 
psychiatrists. AM A Arch. gen. Psychiat., I960, 
2, 434-440. 



to have some predictive value, but this 
did not hold over the whole health-sick- 
ness continuum for patients. 

DR. STRUPP: The study I referred to 
had nothing to say about outcome. These 
were judgments by psychiatrists of pa- 
tients who were seen in initial interviews. 
We tried to explore the factors which our 
raters considered predictive of successful 
outcome. There is also a study by Garfield 
and Affleck, 3 which showed that ratings 
of anxiety bear only a limited relationship 
to ratings of prognosis. So, in terms of 
these findings which apparently diverge 
from Dr. Luborsky's, I was wondering 
how the differences might be explained. 

DR. LORR: One observation is worth 
making: four or five correlational analyses 
of patient and therapist reports have been 
published. 4 It is striking that in each in- 
stance the therapist judgments of im- 
provement are independent of patient 
reports. Further, test scores (Rorschach, 
inventories) are independent of both 
therapist and self-reports. In other words, 
there appears little or no agreement 
among therapist, patient, external ob- 
server, or test as to how much or little the 
patient has changed or improved. 

DR. LUBORSKY: In our studies most 
of the principal quantitative measures are 
really from observers' judgments, which 
are based upon information from patient, 
therapist, supervisor, etc. These observers' 

3 Garfield, S. L., & Affleck, D. C. Therapists' 
judgments concerning patients considered for 
psychotherapy. /. consult. Psyckol., 1961, 25, 
505-509. 

*See, for example: 

(a) Rogers, C. R., & Dymond, Rosalind F. 
Psychotherapy and personality change. Chicago: 
Univer. Chicago Press, 1954. 

(b) Gibson, R. L, Snyder, W. U., & Ray, 
W. S. A factor analysis of measures of change 
following client-centered therapy. /. counsel. 
PsychoL, 1955, 2, 83-90. 

(c) Cartwright, D. S., & Roth, I. Success 
and satisfaction in psychotherapy. /. din. Psy- 
chol, 1957, 13, 20-26, 
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judgments probably correlate more highly 
with therapist's judgments than with the 
patient's judgment. Similarly, the Anxiety 
Level score is based upon independent 
observers' ratings; however, it probably 
correlates highly with therapist's judg- 
ments. The same is probably true for the 
change scores used in our paper. We have 
not yet intercorrelated these measures; 
however, I have also wondered, Dr. Lorr, 
whether the same orthogonality would ap- 
pear in our data and why it has so often 
in other studies. 

DR. BUTLER: I find all these com- 
ments fascinating, but it so happens that 
they tie in with the comments on Dr. 
Shlien's paper. We find, first, starting from 
Dr. Bordin's remarks, that there is a differ- 
ence between the self-ideal correspond- 
ence as a theoretical notion and the self- 
ideal correlation as a measure which is an 
empirical operational expression of that 
notion in this sense Chodorkoff 5 has 
found that people with high self-ideal 
correlations above a certain level tend to 
be more rather than less maladjusted. And 
I think his is a very nice study. 

Now, in our results we started out with 
average self -ideal correlation of zero be- 
tween clients' pretherapy, and higher self- 
ideal correlations for success cases at 
follow-up on a variety of criteria. If we 
factor the results we find 11 kinds of 
clients before therapy on self sorts. Eleven 
types! You might think of these types, 
for example, as differing in organimional 
defenses, but however you think of them, 
the significant fact in relation to many of 
these points that have been brought out 
in Dr. SiegaTs paper also is that these 
different self-factors have differential re- 
lations with the ideal or the ideal factor. 



5 ChodorkoflF, B. Self -perception, perceptual 
defense, and adjustment. /. abnorm. soc. Psy- 
cho!., 1954, 49, 508-512. 

Chodorkoff, B. Adjustment and the discrep- 
ancy between perceived and ideal self. /. elm. 
PsychoL, 1954, 10, 266-268. 



That is, one group of people character- 
ized by a factor will have a high negative 
correlation with the ideal. Another group 
with another extreme will have a pretty 
high positive correlation. It seems there 
is a kind of continuum there. The way it 
turns out, people with the extremes on 
the correlations between self factors and 
the ideal factors are the people who are 
the difficult cases in therapy. The top 
ones tend to be very rigid people as 
Dr. Gorham suggested, and the bottom 
ones tend to be quite disorganized, and 
there seems to be an optimum range in 
between, so the median self-ideal correla- 
tion of zero as a measure obscures the 
self-ideal correspondence as a variable 
because it is not precise enough. If you 
use the factorial techniques which bring 
this out, then the relationship to outcome 
turns out to be predictive. This fits your 
findings in a way I think, Dr. Luborsky, 
in that the cases that tend to have low but 
not markedly negative or markedly posi- 
tive self-ideal correlations are those with 
whom the therapy seems to work. 

Now, with respect to Dr. Lorr's paper, 
this last comment shows also that the 
finding relates to his in the inverse sense. 
We found, and this seems to me to be a 
striking and interesting fact, that the TAT 
ratings, personality ratings by friends who 
did not know the subject was in psycho- 
therapy, ratings by the therapist on gain 
in personal integration, and success ratings 
on an absolute level, all tended to be con- 
sistent if, but only if, the self factors after 
therapy were used instead of the correla- 
tion of self with ideal. In other words, the 
factor loading of an individual on a self 
factor separated the variance in such a 
way that the therapist's judgments, the 
observer's judgments, and the diagnos- 
tician's judgments as measured by the 
projective tests, and so on, all tended to 
go in the same direction (which inci- 
dentally says something of the power and 
sensitivity of the factoring methods). I 
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think the basic point here for theoretical 
discussion is that the self -ideal correlation 
is not the same thing as the theoretical 
variable, that other variables can come in. 
I think the basic question then is, with 
respect to the things that come in, are 
those things consistent with theory? Is it 



consistent with theory that a person with 
a very high self-ideal correlation might 
be a person who is very maladjusted? I 
suspect that it is. I suspect that the para- 
noids, for example, are very low. These 
various results show that there is as yet 
no empirical ideal variable. 



III. 

RESEARCH PROBLEMS RELATING TO THE DEFINITION, 

MEASUREMENT, AND ANALYSIS OF SIGNIFICANT 

VARIABLES IN PSYCHOTHERAPY 



On the Naturalistic Definition of Variables: 
An Analogue of Clinical Analysis 1 

JOHN M. BUTLER, PH.D., LAURA N. RICE, PH.D. 
AND ALICE K WAGSTAFF, PH.D. 



In what follows, the clinical analysis of 
psychotherapy will be considered as a 
particular aspect of naturalistic observa- 
tion and research. Our intention is not 
to defend or justify naturalistic observa- 
tion and research (the clinical process). 
Rather, it is an attempt to formulate some 
aspects of the process leading to unam- 
biguous methods of analysis, the methods 
yielding results partaking of the character 
of hypotheses which function so as to lead 
to more refined hypotheses (or to experi- 
mental arrangements which are validating 
or invalidating) . 

When one considers the philosophy and 
teaching of science, it is significant that 
little, if any, formal attention is paid to 
naturalistic observation and research, al- 
though it is quite clear that they are the 
foundation of all science. In modern sci- 
ence, discussion is usually concentrated 
upon questions of verification and the 
nature of scientific knowledge. Yet the 

1 The investigations reported here were sup- 
ported by funds from the Ford Foundation. 

We wish to express our appreciation to Drs. 
Desmond Cartwright and Donald W. Fiske for 
making case recordings and test data available 



science of physics is profoundly indebted 
to the uncontrolled observations of super- 
stitious Babylonian and Chaldean priests. 
In the year just past we have witnessed 
world-wide observances of the centennial 
of that triumph of naturalistic observa- 
tion and research, the Darwinian theory 
of evolution, which is still revolutionizing 
our perspectives of the biological world 
and, indeed, of ourselves. Yet, in current 
discussions of scientific philosophy, there 
appears to be a stress upon two aspects of 
science: experimental method and the 
personal element, the latter being dis- 
cussed under such headings as "genius," 
"creativity/* "scientific imagination," and/ 
or luck. 

Actually, scientific method, verification, 
is valued in itself, but those who practice 
scientific method are not. It seems to be 
agreed that verification may call for an 
admirable degree of ingenuity. But no 
matter how admirable the ingenuity, it re- 
mains ingenuity; the experimentalist is 
really somewhat below the salt. The high- 
est rank he can attain is that of Boyle, The 
deepest admiration is reserved for the 
scientists like Newton or Einstein or 
Darwin who, by the creative use of their 
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imagination, in the context of the world 
of science, erect revolutionary theories or 
contrive somehow, like Fleming, to see 
the significance of accidental events and 
to capitalize on them. It turns out then, 
that in order to significantly advance sci- 
ence, we must have flashes of genius or be 
lucky. This approach to understanding 
science creates a rather prickly and un- 
comfortable situation for the majority of 
scientists who, however much they aspire 
to be geniuses, are not; and who, however 
much they wish to be lucky, are forced 
like the rest to wait their turn for the 
event which is unlikely to happen. 

The sense of discomfort increases if 
one is in a borderline science, if one is 
essaying a domain in which basic and 
fruitful concepts like those of Einstein, 
of Newton, and of Darwin have not been 
formulated; where experimentation, as in 
certain areas of psychology, seems to be 
reduced to empty formalism because posi- 
tive knowledge does not exist which tells 
us what should be controlled. 

When a scientist enters into an inquiry 
in a new domain, his ideas, however pre- 
cise as ideas, are hazy with respect to the 
domain simply because it is a new domain. 
When the phenomena under considera- 
tion are not well described, when rela- 
tionships at the phenomenal level are not 
known, the person who insists on start- 
ing out with precise experiments lacks 
the imagination required to observe, to 
look around and see, at the first level, 
what seems to be going on. Experiments 
which precede rather than succeed obser- 
vation amount to being precise about 
vagueness and suggest a disproportionate 
concern for the opinions of other sci- 
entists with a disproportionate lack of 
concern for truth which, above all, should 
characterize the scientist. It seems to the 
writers that the scientist who wishes to 
bring a new domain under the sway of 
science should seek to observe, to arrive 
at preliminary hypotheses or systems of 



hypotheses on the basis of his observa- 
tions. His ultimate aim, of course, should 
be the ultimate aim of any scientist, that 
of generating sets of propositions which, 
at crucial points, are verifiable in the sense 
of scientific method. His immediate aim 
then should be to arrive at fruitful 
hypotheses. 

In our present stage of understanding 
science, the creation of fruitful hypothe- 
ses must await the moment of insight of 
the genius or the lucky event which only 
the genius appreciates. Nevertheless, as 
psychological experimentation has shown 
quite clearly, the appropriate arrange- 
ment of situations can lead to insight into 
situations or can retard and prevent the 
occurrence of insight. The aim here will 
be to describe an approach to the data 
of naturalistic observation which, it is 
hoped, will encourage the development of 
fruitful hypotheses with respect to the 
domain of inquiry. 

NATURALISTIC OBSERVATION 

As conceived here, the naturalistic ob- 
server approaches his domain of inquiry, 
considered to be some behavioral situa- 
tion, with several sets of convictions, be- 
liefs, frames of reference, biases, preju- 
dices call them what you will which 
will hereafter be called a classification sys- 
tem. To a first approximation, at least, 
the observer knows what behavior is. 
That is, he has a definition, explicit or 
implicit, of what behavior is and he 
knows in a preliminary way what be- 
havior he is interested in observing. Sup- 
pose now that he observes a single organ- 
ism behavior over a series of occasions 
and that each occasion covers a period of 
time such that several behaviors are ob- 
served. Then the observer has collected 
two sequences of observations, the se- 
quence within occasions, and the sequence 
of occasions. It seems to be a reasonable 
assumption that if the observer is to 
come out with some hypotheses based on 
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the organism's behavior, he will consider 
the behavior within occasions. And he 
will consider not only what does occur, 
but what does not occur that could be ex- 
pected to occur. Also he will notice which 
events follow on each other and which 
events do not follow on each other. Such 
considerations might lead to conclusions 
or hypotheses about what might be called 
the behavioral structure of an occasion. 
But there is also a sequence of occasions. 
Therefore, there will be a set of occasions, 
each having its own structure. The set 
of occasions constitute the data of our 
naturalist. 

In addition to considering the sequence 
of occasions as such, the naturalist un- 
doubtedly takes into account not only the 
sequence of occasions, but tries to see 
relationships among the behaviors over 
the whole set of occasions without regard 
to the structure of each occasion. 

In other words, what is noticed among 
other things, is which events follow on 
each other and which events do not follow 
on each other over all the occasions. It 
can be seen then, if the naturalist is ob- 
serving many behaviors over many occa- 
sions, that his observations can aggregate 
to an impressive number. And they can 
easily aggregate to an overwhelming 
amount as the number of organisms ob- 
served increases. 

Now suppose what probably is actually 
not often the case, that the categories of 
observations of the naturalist are mu- 
tually exclusive. Were this so, it could be 
shown that the nature of classification sys- 
tems is such that it might well appear to 
the observer that there is order in the data 
in the sense that scientists think of order as 
"underlying relations." Also, from well- 
known experimentation in psychology on 
memory, learning, and forgetting, it is 
clear that the classification system of the 
observer may change continually as obser- 
vation proceeds, so that the very process of 
observations may be, and really always is, 



conditioned by the preceding observa- 
tions. Thus, the very process of data for- 
mation, from one point of view, changes. 
From another point of view it can be 
said that the classification system of the 
observer is continually conditioned by the 
observations. Thus we see that all is in 
flux, the observer has a frame of reference 
which is not fixed, which can change as 
a result of the very process of observation. 
Furthermore, what we know about mem- 
ory indicates that additional changes in 
the frame of reference and of the data 
conceived as the ordering of observation 
into the frame of reference of the ob- 
server, come about as a function of time. 
Bartlett's fascinating study of remember- 
ing, as well as a host of others, indicates 
that upon reflection after the events, the 
inner nature of the events seems to have 
changed. 

Consider that naturalistic observer, the 
psychotherapist. He is, mainly at least, 
observing the communicative or linguistic 
behavior of a patient or group of patients 
over periods of perhaps hundreds of 
therapy hours. Therefore, even were his 
classification subclasses few in number 
and mutually exclusive, the observations 
would amount to a really overwhelming 
array of data. Even when the psychothera- 
pist takes notes, these can really be re- 
garded, no matter how voluminous, as at 
best, aids to memory. The therapist, a 
Freud for example, then must remember 
over long periods of time and over many 
patients, what happened, what didn't hap- 
pen, etc., in addition to considering infor- 
mation not obtained in the therapy hour. 
Then he creates on what he conceives to 
be his observations, a theory of psycho- 
therapy and a psychological theory of 
personality. No matter how plausible and 
convincing these theories may be, it is 
clear that the interaction of observer and 
observed, the personal or subjective ele- 
ment, can and probably does play a large 
part in the creation of the theory and in 
such a way that we do not know to what 
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extent the theories describe the theorists 
or the patients. 

It would indeed be a humbling and cor- 
rective experience for a psychotherapist 
to have copies of the original situations, 
such as sound recording or sound motion 
pictures, played back after a case descrip- 
tion and analysis. For he would no doubt 
discover that while there were "essen- 
tial truths" in his formulation, what was 
described as having a dramatic unity had 
in fact far less unity, was much more scat- 
tered throughout the observations than 
his formulations indicated. And he would 
also find that what on listening or view- 
ing seemed to be important events, had 
been neglected in his formulation. In 
other words, faithful copies of the events 
lead, upon presentation to the original ob- 
server, to a change in the classification 
system or hypotheses consequent upon his 
original observation. Even were the psy- 
chotherapist unbiased or uninvolved, the 
case would be the same because of the 
large numbers of responses displayed by 
his patient. 

The considerations outlined above sug- 
gest the basic function of naturalistic ob- 
servation. The function of naturalistic 
observation and research is to generate 
hypotheses concerning the underlying 
structure, when present, in behavioral do- 
mains. It is not to test hypotheses. The 
testing of hypotheses is in the province 
of the experimental method and, in cer- 
tain situations, of statistical methods. 
Generally speaking, the use of experi- 
mental method depends upon control, and 
by control is meant the control of relevant 
conditions or variables. Seldom it is, if 
ever, that everything can be controlled. 
Thus the use of experimental method de- 
pends upon previous positive knowledge 
or upon insight gained in uncontrolled 
situations. But uncontrolled situations are 
just those covered by naturalistic observa- 
tions. Thus, if we can improve natural- 
istic observation, we are more likely to 



be in a position to have insight into what 
should be controlled in advancing an ex- 
perimental attack upon the domain of 
inquiry. 

The function of naturalistic observation 
being the generation of hypotheses, a 
basic problem of such observation is at 
once apparent. That is what might be 
called objectifying the observations or 
moving from the act of observation to the 
recording of data. The recording of data 
is thought of as obtaining a record of 
behavior in symbolic form. Getting such 
data implies: 

(a) a standard definition of what con- 
stitutes a response; 

(b) a classification scheme or system 
into which responses are ordered 
as they occur. 

In what follows it will be assumed that 
the investigator has a standard and speci- 
fiable definition of a response. 

The function of the classification sys- 
tem in naturalistic observation and analy- 
sis is to provide an objective record of 
behavior such that once the period of ob- 
servation has ended, one can tell with 
certainty what was observed. Therefore, 
the classification should be objective in 
the sense that two observers would to a 
very high degree classify behavior the 
same way; the classification scheme should 
be specifiable and reliable. To the extent 
that it is not, the classification system is 
personal and unreliable. Secondly, the 
classification system should have mutually 
exclusive subcategories, unless the classi- 
fying behavior of the investigator is the 
object of investigation. When the classes 
are not mutually exclusive, cross-classifica- 
tion may be dependent; some of the pos- 
sible cross-classification will be mere 
artifacts. 

It seems that reliability and mutually 
exclusive subclasses represent minimal 
characteristics of a satisfactory classifica- 
tion system. A reliable classification sys- 
tem with mutually exclusive classes would 



182 



RESEARCH IN PSYCHOTHERAPY 



provide an objective record of behavior 
over a series of observations and would 
push the problems of subjectivity and 
insight back where they belong; namely, 
into the creation of the classification sys- 
tem itself and to the generation of hy- 
potheses based upon analysis of the classi- 
fied behavior. 

Since the number of classified behaviors 
or data may be very large, it seems that 
an additional criterion of a minimally 
satisfactory classification system would be 
that it be susceptible of objective analysis, 
preferably analysis of a type which treats 
the classification system and the data as 
a unit. 

The three criteria of a minimally satis- 
factory classification system by no means 
exhaust the problems inherent in classify- 
ing behavior. For it is clear that an arbi- 
trary number of classification systems can 
be applied in the same observational 
situation. And the same applies to the 
definitions of response. When we have 
two different universes of discourse, con- 
nected, possibly, only by a standard defini- 
tion of response, then two criteria of the 
relative validity of the systems might be 
called internal productivity and external 
productivity; internal productivity being 
some index of the amount of order in the 
behavioral data and external productivity 
being some index or set of indices indi- 
cating relationships between the behav- 
ioral data and other data. A somewhat 
analogous distinction is made in mental 
test theory between the kind of validity 
described by the correlation between a 
test and the factor (or factors) it repre- 
sents and the kind of validity described 
by the correlation between a test and an 
external variable. Given two classification 
systems, the first having more internal and 
external productivity than the second, it 
seems dear that the first is preferable to 
the second. It should be noted, however, 
that one system might have more internal 
productivity and less external productivity 



than the other, and vice versa; in that case 
the two criteria might not point to the 
same decision. 

A further distinction to be made con- 
cerns the "grain" of the classification sys- 
tems. A fine-grained system is one with 
relatively many subclasses and a coarse- 
grained system, one with relatively few 
(and as few as two) categories. A system 
with only two subclasses really has but 
one, for a two-class system can describe at 
most but one kind of organism-environ- 
ment transaction, all other kinds being 
lumped together in the remainder class. 
Thus the two-class system represents the 
ultimate in coarse-grained systems for, of 
course, a one-class system is completely 
determined. A completely determined sys- 
tem can yield no information. Since the 
behavior of organisms is complex, it 
would seem that a three-class system, and 
other relatively coarse-grained systems, 
would be less likely to be productive, 
other things being equal, than relatively 
fine-grained systems. For fine-grained sys- 
tems are less likely to have responses clas- 
sified into the remainder class. 

In coarse-grained systems, behavior is 
likely to be classified into the remainder 
class because attention is centered on a 
few kinds of behavior; in fine-grained sys- 
tems, however, such classifications are 
likely to be made because of inability to 
identify the class into which to order the 
response. In such a case the class "un- 
classifiable" becomes a subclass of the 
remainder class. In actual investigations 
it is probably desirable to record, in addi- 
tion to the explicitly defined categories, 
the unclassifiable and remainder classes, 
for they will often be of considerable in- 
terest and could yield valuable informa- 
tion. 

A criterion related to that discussed 
above is exhaustiveness. An exhaustive 
system is one in which all responses are 
classified into the explicit categories and 
none are classified into the unclassifiable 
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and remainder cksses. It seems reason- 
able to suppose that the more exhaustive a 
system is, the more productive it is likely 
to be. 

In general, then, a satisfactory classifica- 
tion scheme will have mutually exclusive 
subclasses, be susceptible to routine analy- 
sis, and will possess internal and external 
productivity. Productivity is in turn likely 
to be dependent upon "grain" and exhaus- 
tiveness. These rather rough, ready, and 
commonsensical criteria are somewhat 
vague and lack the sense of closure ob- 
tained by means of a complete intellectual 
scheme. However, they seem to be serv- 
iceable criteria and can be used to some 
extent for developing a classification sys- 
tem before observation formally begins. 
Some of the criteria, especially productiv- 
ity, will be more sharply delineated later. 

It will be remembered that the behavior 
being considered here is completely un- 
controlled by the investigator. Neverthe- 
less, the classification system is somewhat 
analogous to a control of behavior in the 
sense that the observer is insisting on per- 
ceiving the behavior observed in terms of 
the classification system he is employing. 
Thus the observer is willy-nilly control- 
ling his experience, as in an experiment, 
but, perhaps, in an undesirable manner. 
That is, his classification scheme may sim- 
ply be an objectified set of prejudices hav- 
ing much to do with the misguided 
imagination of the observer but contain- 
ing no insight about the kind of organism 
observed. In this case, it is likely that 
analysis of the data will reveal only the 
folly of the originator of the classifica- 
tion system. A properly conceived and 
executed experiment, however, does not 
fail to yield real information. This is in 
the very nature of the process of experi- 
mentation. It therefore behooves the 
naturalistic observer to be as carefully 
imaginative in constructing his classifica- 
tion system as he can possibly be; to fuse 
his creativity and experience to the end 



of constructing a more than minimally 
satisfactory classification system. 

The desirability of extreme care and 
maximal creativity in constructing a clas- 
sification system can be seen by consider- 
ing a situation in which behavior is 
physically controlled by limiting the be- 
havior of the organism to series of finite 
alternatives. The maze in which the or- 
ganism is restricted to right and left turn 
behavior is a good example; so are Fabre's 
caterpillars endlessly circling the post 
on which he placed them. Such simple 
situations, hardly to be conceived as con- 
stituting full experimental control, have 
yielded a wealth of information about 
response acquisition and instinctive be- 
havior. Now in the maze, for example, 
the alternatives can be considered as a 
two-class classification system, and analy- 
sis of the sequence of alternatives ex- 
pressed in the behavior of the organism 
can be handled, as will be shown later, in 
the same manner as with the classifica- 
tion systems which do not imply the im- 
position of physical limitations upon the 
behavior of the organisms being observed. 
To make the point in a rather fanciful 
manner, when the organism is merely 
observed, the organism "selects" as be- 
havioral alternatives the subclasses of the 
observer's classification system. When 
there is more control, choices are forced 
upon the ogranism by environmental con- 
ditions imposed by the investigator. In 
neither case is it remarkable that a 
"choice" is made. In the first case, how- 
ever, "selection of alternatives" may have 
nothing to do with the organism observed 
and everything to do with the observer. 
In the second case selection of alterna- 
tives actually represents transactions, 
however "artificial" the environment may 
be. In other words, in the second case 
the behavior represents an actual organ- 
ism-environment transaction. In the first 
case the classified behavior may show only 
that behavior occurred; the classifications 
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may not represent any actual transaction 
between organism and environment. This 
is the defect of uncontrolled observation; 
it may be observation of no more than 
the fact that responses occurred a given 
number of times. Thus the necessity for 
the basic criterion of productivity. For 
productivity guards against just the pos- 
sibility that a given classification system 
is irrelevant to a given group of organism- 
environment transactions or responses. 
For it is here conceived that an irrelevant 
but specifiable and reliable classification 
system would for a given set of responses 
be unproductive. That is to say, an irrele- 
vant system would result in data exhibit- 
ing no order. 

A naturalistic investigation is con- 
cluded when analysis of the data results in 
a demonstration that the system is unpro- 
ductive or productive as the case may be. 
If the system is productive, the end result 
should be a sharpened and refined set of 
hypotheses leading to a better classifica- 
tion system with which to approach the 
domain. Or it may result in a set of 
hypotheses so refined as to indicate what 
is to be controlled and varied in an ex- 
perimental attack upon the domain of 
inquiry. 

The nature of exploratory investigation 
being what it is, it starts and ends with 
personal creation. Usually personal crea- 
tion, the subjective element, pervades the 
entire process, often to the detriment of 
the investigation. The personal, subjective 
element should be confined to the begin- 
ning of the investigation when the classi- 
fication system is being devised and made 
explicit, and to the end when the routines 
of analysis have provided the formal re- 
sults upon which personal creativity 
should operate. 

MATHEMATICAL ANALOGUE 

A mathematical counterpart of the 
ideas presented in the preceding discus- 
sion can be constructed rather straight- 



forwardly. Consider a classification sys- 
tem with q mutually exclusive subclasses 
and a group of / subjects for each of 
whom just n responses have been classi- 
fied. Each response of a subject may be 
represented by a column vector with one 
unit entry and q -1 zero entries, and the n 
responses of each subject may be repre- 
sented as a column vector with n unit 
entries and n(q 1) zero entries. Ar- 
ranging all of the t columns into a data 
table then gives the nq X t data matrix 
s lj = lor0 [1] 

where Sjj is the element in the i-th row 
and the j-th column of the data matrix, 
hereafter denoted by S. S is what we 
call the standard or primitive form of the 
data, for it represents the behavior of the 
subjects as it occurred; in other words it 
shows just what the subject did and did 
not do and when. 

The data matrix, S, represents the be- 
havior in such a way that corresponding 
to the i-th response of the / subjects 
there is a q X t submatrix of S contain- 
ing t unit entries and t(q -1) zero en- 
tries. From this circumstance it can be 
shown that the rank of S is at most nq 
n + 1 when t is greater than n (q 1 ) . 
The difference between nq and nq n 
+ 1 is a consequence of considering al- 
ternative subclasses of the classification 
system as mutually exclusive. 

Given S, attention can be shifted to the 
question of the internal productivity of S 
and to the question of the underlying 
structural relations, if any, embodied in S. 
These questions have been considered in 
detail in Butler, Wagstaff, Rice, and 
Counts (I960). Here we will emphasize 
the fundamental conclusions. 

We conceive of the responses of the 
subjects as being determined by response 
tendencies or dispositions. These ten- 
dencies to respond are not mutually ex- 
clusive although the actual responses are. 
Corresponding to S is a matrix S* which 
is a representation of the response ten- 
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dencies generating S. For the i-th re- 
sponse in S there is a q X t submatrix, 
the row vectors of which are necessarily 
orthogonal. The corresponding vectors in 
the corresponding q X t submatrix of S* 
are not necessarily orthogonal. Therefore, 
S* cannot refer to actual behavior since 
the behavioral alternatives are mutually 
exclusive. 

Consider now the matrix 

Ro=l/tSS' [2] 

This matrix is nq X aq and is square 
symmetric. The elements of [2] are P^ 
where Pij is the proportion of subjects 
behaving the same way in rows i and j 
of S. Being a proportion P^ may vary 
between zero and unity. Given the i-th 
row of R and summing across the first 
q columns, then the second q columns, 
etc. yields for each set of q columns the 
value P u , the diagonal value of the i-th 
row in R . Thus the sum of each row 
of RO is nP n . 

We now require that, in order to be 
able to state that the classification system 
is internally productive and that there is 
an underlying set of structural relations 
or response tendencies, the following re- 
lations hold: 

R O -R; = D [3] 

where D is a diagonal of square blocks 
of order q X q which correspond to the 
n responses and RS in an nq X aq 
square symmetric matrix with elements 
PIJ except for the elements in the n dif- 
ferent q X q principal submatrices cor- 
responding to the n responses. Rj is 
obtained from S* in the same way as R 
is obtained from S. 

The entries in [3] imply that the em- 
pirical proportions based on the behavior 
of the subjects are reproduced by S* with 
the exception of those proportions in the 
q X q blocks around the main diagonal 
of R . The proportions in these blocks 
are fixed as P tl and as zero by the restric- 
tion that responses be mutually exclusive. 



Adding the requirement, which seems to 
be a natural one, that the row entries of 
each of the w q X q principal submatrices 
of RJ sum to PU, we have the circum- 
stance that the rows of R* sum to 
nP u as do the rows of R . Since the 
entries of RU and of RO are the same 
outside of the q X q diagonal blocks, 
R* and R have the same first centroid. 
Furthermore, comparison of RO and of 
Ro* shows that if they are to be different, 
then, from the restrictions stated, the 
q X q blocks in RJ must be nondiag- 
onal since the q X q blocks in RO are 
diagonal. Now R and RJ must be dif- 
ferent if the classification system is inter- 
nally productive except for the limiting 
and ideal case when the row vectors of S 
having any unit entries in common are 
identical and when those that are different 
have nothing in common. This is surely 
the ideal case in which the classification 
system has maximum internal produc- 
tivity, for then the differentiation be- 
tween classes of behavior is maximal. 

When the ideal case does not obtain, 
the row vectors of S overlap but are not 
identical; then S* will differ from S and 
the rank of S* will be less than the rank of 
S if the system is at all productive. As in 
factor analysis, S* is not directly obtain- 
able. However, factoring of R*., anal- 
ogous to factoring the reduced correla- 
tion matrix of factor analysis, expresses 
the vectors of S* in a linear basis or 
coordinate system. The problem in ex- 
ploratory analysis is similar to that in 
the factor analysis of quantitative variates. 
By substituting communalities for the 
diagonal values of RO one gets RJ. Then 
one may go through the routines of fac- 
toring to obtain a factor matrix express- 
ing the vectors of RJ in a basis. Since 
the entries of R are all zero or positive, 
a factor matrix may be obtained, the en- 
tries of which are all zero or positive: we 
restrict our attention to such matrices, for 
those with negative entries have no direct 
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behavioral interpretation. Behavior ap- 
pears or it does not appear. This restric- 
tion guarantees a unique factor matrix 
when the configuration of vectors is or- 
thogonal. When the configuration is not 
orthogonal, a factor matrix which is 
unique, in the sense that it contains the 
least possible linear dependence, may be 
obtained. This factor matrix, hereafter 
called the simple factor matrix or the 
factor matrix of the simple basis, is ob- 
tained by making each factor collinear 
with one of the vectors of the configura- 
tion. Since negative entries are not per- 
mitted, these vectors are the outer vectors 
of the configuration. When the configura- 
tion is orthogonal, the factors comprise a 
simple basis or coordinate system which 
is unique because any rotation of factors 
would produce a factor matrix with nega- 
tive entries possessing no direct be- 
havioral meaning. 

Loadings on the basis vectors (factors) 
serve as the beginning point for infer- 
ence and hypothesis formation just as in 
the factor analysis of quantitative variates. 
Internal productivity is assessed in two 
ways. First the rank differential, r/nq 
n + 1, where r is the rank of RJ, 
is computed. The expression in the de- 
nominator is the maximal possible rank. 
The lower limit of the rank differential is 
1/nq n + 1, which indicates high inter- 
nal productivity, and the upper limit is 
unity, which indicates no internal pro- 
ductivity. The second and more significant 
sign of internal productivity is the index 
of internal productivity, 1 - [u/ (r 2 - r) ] 
where a is the sum of the off-diagonal 
elements of the matrix of inner products 
of the unit length factors. When the vec- 
tors of the simple basis are orthogonal, 
the matrix of inner products of basis 
vectors is an identity matrix, then the 
index has a value of unity for u has a 
value of zero. The lower limiting value 
of the index is zero for the upper limit 
of u is r 2 r. 



Factoring RJ simultaneously provides 
for assessment of internal productivity 
and for the factor matrix which is the 
beginning point for hypothesis formation. 
When the rank differential is unfavorable 
(high value) and the index of internal 
productivity is low, computing the factor 
matrix for the simple basis is a super- 
fluous effort. 

Analysis of RO is equivalent to analyz- 
ing the relations between the rows of S. 
Analysis of the rows might be character- 
ized, somewhat crudely to be sure, as a 
"trait" analysis. Sometimes one might 
wish to make a "type" analysis. This is 
equivalent to analyzing the columns of S 
or matrix S', the transpose of S. A suit- 
able matrix for analysis is then 

l/nS'S = Ro [4] 

where n is the number of responses. The 
entries of [4] show on a scale from zero 
to unity the similarity of behavior from 
subject to subject. Considerations similar 
to those of the analysis of S apply. Esti- 
mating communalities and factoring will 
provide a simple basis from which in- 
ternal productivity can be assessed. 

PLACE OF THEORY IN NATURALISTIC 
OBSERVATION 

In the introductory section we have 
said that observation should precede ex- 
perimentation, and yet we recommend 
that the naturalistic observer should bring 
to the construction of his classification 
system all the creativity and experience 
he can muster. It is precisely here, in our 
opinion, that the function of theorizing 
enters in. We conceive of theorizing 
more accurately, perhaps, construction 
building at this stage, not as a source 
of testable propositions, but as a system- 
atization of experience, one's own and 
that of others, which can stimulate and 
enhance our individual creativity. It 
should serve to guide us in deciding which 
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of literally hundreds of aspects of the be- 
havior might be interesting to observe. 

If one takes seriously the function of 
naturalistic observation and research as a 
method of discovery, then it follows that 
the classification system devised should 
remain as close as possible to the be- 
havioral level. That is, a given class 
should contain behaviors that are similar 
as behavior rather than containing units 
that are dissimilar behaviorally but are 
thought to be conceptually related. An 
example of the latter would be such a 
class as "resistance" which might include 
silence, change of topic, and sundry other 
behaviors thought to be indices of some 
inner state, called "resistance." Clearly, 
as soon as such a concept intervenes, a 
hypothesis has already been built in and 
we are one step removed from behavior; 
the first step of discovery has been by- 
passed. Of course the unit of behavior 
we observe is complex, and of course we 
observe some things rather than others, 
influenced by our own prejudices, pre- 
conceptions or theories, but as long as we 
are including in a given class units that 
are directly observable as involving the 
same behavior, we can discover what goes 
with what. Whatever we choose to call 
such classes and however many hunches 
we have concerning the clinical signifi- 
cance of a given class of behaviors, the 
real definition of the class lies in the be- 
havioral descriptions used by the judges 
in placing a unit of response in Class A 
rather than in Class B. 

STIMULUS HUNGER AS A BASIC DRIVE 

This section summarizes briefly the 
ideas presented in our paper "Self -actual- 
ization, new experience, and psycho- 
therapy" (Butler & Rice, I960). As a 
result of some of the questions that we, as 
therapists, asked ourselves, we undertook 
a survey of some of the literature in ex- 
perimental and comparative psychology, 



covering studies at the prehuman level, 
embryological studies, and studies of 
neonates and children. We arrived at the 
conviction that self-actualizing processes 
have a primitive base, that this primitive 
base has many of the characteristics of the 
so-called physiological drives; that it is 
as independent of the physiological drives 
as the physiological drives are of each 
other; and that as a derivative or result, 
self -actualization depends primarily upon 
the satisfaction of this drive. We con- 
sider that this drive, which we have 
called "stimulus hunger" is the basis for 
much of what is constructive, creative, 
and self-actualizing in human life, and 
on the negative side for much, though far 
from all, of what is negative, destructive, 
and self -limiting. 

This drive, stimulus hunger, shows in 
behavior as an ever-present tendency for 
the organism to get new experience, 
either in the form of new stimulus objects 
or in the form of change in the level and 
mode of stimulation. In the naive or 
primitive organism this is almost wholly 
a tendency to get new sensory influx. In 
a symbol-using, symbol-creating organism 
such as the human child, we emphasize 
the broader meaning of "new experience" 
rather than simply input from the en- 
vironment. We are not emphasizing the 
sensorium, but rather the commerce of 
the entire nervous system of the organism 
with the stimuli. That is, we are talk- 
ing about behavior and its immediate 
precursors perceptions, ideas, sensations, 
and the like. We take the position that 
both thinking (a central process) and 
motor outflow have as much right to be 
regarded as experience as has sensory 
influx. Furthermore sensory processes, 
thinking, motor outflow, and behavior 
are processes which cannot be sharply de- 
lineated from a neurological standpoint. 

It seems plausible, therefore, that there 
is a tendency to think new thoughts which 
is not in principle different from the tend- 
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ency to get new stimuli. And what in- 
hibits thinking is what inhibits adient 
behavior to new stimuli, namely punish- 
ment. 

Self-actualizing tendencies, then, are 
just the tendencies to think new thoughts; 
thinking creates experience in much the 
same fashion that approaching stimuli 
creates new experience. It is the ap- 
proaching, behaving, adjusting, preparing 
to respond, in relation to the stimuli 
which is the experience or experiences, 
not the new stimuli; it is the thinking 
processes (and their motor patterns) 
which are the experience, not just the 
thought contents. Stimulus hunger has 
to do with a wide range and variety of 
thinking, and as a process the range and 
variety of thinking or conceptualizing 
provides new experience for the organ- 
ism in much the same sense as the pres- 
ence of new stimulus configurations. 

The line of reasoning presented above 
has immediate implications for psycho- 
therapy. We see therapy as a continuing 
search for new elements and the forming 
of creative recombinations of new and 
old elements. At its best there is a tre- 
mendous amount of new experience, 
proving painful, certainly, but also in- 
tensely satisfying. The effect of a stim- 
ulating therapist style is to arouse or 
re-arouse within the individual more asso- 
ciations, images, trains of thought, etc. It 
enables the client to generate new experi- 
ence for himself. It seems obvious that 
the stimulus (therapist communication 
and behavior) with the greatest connota- 
tive range, with the most far-reaching 
reverberations within the organism, re- 
sults in a maximum of satisfying experi- 
ence. 

There is one qualification, however, 
which must be made. Aversive stimula- 
tion, especially anxiety and fear, inhibit 
and channel both thinking and behavior. 
Aversive stimulation seems to be pre- 
potent over adience. Certain forms of 



therapists' communications might be 
highly stimulating but also be carriers 
of inhibiting and channelizing effects. 
As a case in point the psychoanalysts have 
described defensive and regressive reac- 
tions to interpretations of motives, im- 
pulses, etc. Such interventions, although 
they may be stimulating, may also leave 
the client with little control over the 
kind and quantity of internal arousal. 
When the therapist communicates within 
the frame of reference established by the 
client, the client has control of this kind 
because the therapist is not perceived as a 
to-be-coped-with event. 

The preceding ideas lead us to the fol- 
lowing proposition: 

Given n semantically equivalent state- 
ments, the one possessing the greatest 
range of connotation is that which is the 
most stimulating. Alternatively we might 
say that given n paraphrases of the same 
message, one may possess a greater range 
of connotations than the others, thus pro- 
viding a basis for an increased range of 
thinking or experiencing in a respondent. 

Let us assume for example, that five 
experienced therapists are responding to 
the same client message. Let us further 
assume that they are all equally accurate 
and equally accepting in their attitude 
toward the client. Our contention is that 
each of the five might well respond in a 
style that was different from the styles 
of the others, and that each of these styles 
might have different experiential conse- 
quences for the client and consequently 
different behavioral consequences in the 
further participation of the client. 

Under the three conditions of prizing, 
understanding, and stimulating, we hy- 
pothesize that the self-actualizing tend- 
encies of clients will function. They can 
begin to create new experience for them- 
selves; they can be "open to the creation 
of new experience" and thus can break 
through the endless repetition of experi- 
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ence so characteristic of maladjusted 
persons. 

IMPLICATIONS FOR CONDUCT OF 
THERAPY 

The specific implications of this view- 
point will be discussed later in the paper, 
inasmuch as they are embodied in the 
dimensions of the Therapist Classification 
System. The more general impact of this 
thinking is that it leads us to view the 
therapy relationship as a situation in 
which each member serves as a particukr 
kind of stimulus for the other. Each is 
putting certain constraints on the be- 
havior of the other, each may be facilitat- 
ing in the other behavior that might not 
otherwise be possible. Our exploration of 
the therapy process, then, focuses on the 
question: What kinds of stimuli are the 
client and therapist being, each for the 
other, during the therapy hour? 

First let us distinguish between par- 
ticipative style and specific content. In 
client-centered therapy the therapist con- 
trols the content of his responses in the 
sense that he chooses to stay within the 
frame of reference of the client. This is a 
deliberate choice on the part of the thera- 
pist, based on theoretical considerations. 
Although this might seem to reduce the 
stimulus value of the therapist, there are 
some excellent reasons for doing this: 
(a) it reduces the interpersonal anxiety, 
thereby providing for greater tolerance of 
intrapersonal anxiety and for the kind of 
climate in which conjunctive communica- 
tion can flourish; () it helps to keep the 
balance of initiative on the side of the 
client; (c) it is consistent with the hy- 
pothesis, to be discussed later, that the 
"meaning" of a client's key experiences 
resides in the experiences themselves. 
These "meanings" need not be inter- 
preted from outside but are potentially 
available to the client for reorganization 
if he can be helped to re-experience them 
under certain therapeutic conditions. 



Even though the impact of the therapist 
may be lessened (we entertain this pos- 
sibility; we do not hold it) by his staying 
within the client's frame of reference, this 
still leaves the therapist with, at least 
potentially, a very high stimulus value 
simply in his style of participation. It 
is just here, however, that the therapist 
tends to become client controlled, though 
not usually as a conscious or deliberate 
choice. 

Take, for example, the inexpressive 
client, who speaks in a flat (or speech- 
making) voice, who deals with each sub- 
ject of discussion in an abstracting, ana- 
lytical way, using extremely inexpressive 
language. Granted that these stylistic 
characteristics may stem from his emo- 
tional problem, they have, in our opinion, 
an effect on the therapist which lessens 
the chance of a successful therapy, beyond 
the difficulty that would be expected 
from the extent of the emotional dis- 
turbance. The therapist's style of par- 
ticipation tends to become inexpressive 
and similar to that of the client, and the 
therapist then becomes a weaker and less 
adequate stimulus for the client, further 
damping the style of the client. 

On the other hand the client who 
speaks in a voice of intense involvement, 
who expresses feelings with directness, 
using language that generates vivid 
imagery in the hearer, stimulates his 
therapist to the end that he becomes more 
expressive, thus in turn re-stimulating 
the client. Therapy then becomes an ex- 
citing and productive experience for each 
participant. 

The implications of this thinking for 
the conduct of therapy might be as fol- 
lows: (1) While the content of his re- 
sponses is controlled by the conscious 
choice of the therapist, his style of par- 
ticipation is not usually a matter of choice 
and tends to become similar to that of 
the client. (2) The client is in turn in- 
fluenced by the style of the therapist, 
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tending to move toward his style, though 
probably at a slower rate. ( 3 ) In addition 
to their impact on the therapist, certain 
dimensions of the client's style of par- 
ticipation are in themselves vehicles of 
therapeutic change, and can be shown to 
be related to measures of therapy out- 
come. (4) If the therapist could estab- 
lish stylistic independence of the client 
on a fairly expressive level, the client 
would be stimulated toward more expres- 
sive participation. (5) This change in 
style of participation of the client would 
in turn be accompanied by a more favor- 
able outcome than would be predicted 
under usual circumstances. 

CONSTRUCTION OF TOE CLASSIFICATION 
SYSTEMS 

The client classification system and the 
therapist classification system are both 
based on a combination of the empirical 
and the theoretical. In the case of the 
client system, classes of behavior were 
chosen which seemed to differentiate be- 
tween interviews which were considered 
"good," mediocre, or "bad" by client and/ 
or therapist. From listening to these 
we tried to identify styles of participa- 
tion that varied in a meaningful way in 
relation to the seeming value of the inter- 
view. Then each of the preliminary classes 
was considered from the standpoint of 
our theorizing about therapy. Does each 
subclass of each class make clinical sense, 
or are they perhaps just concomitants of 
some more significant stylistic variable? 

In the case of the therapist classifica- 
tion system, the situation was somewhat 
reversed. We first thought of aspects 
which seemed likely to be crucial in the 
impact of the therapist on the client, and 
then listened to selected tapes to see if 
therapists did indeed seem to vary sig- 
nificantly along these dimensions. In both 
classification systems, however, the rela- 
tionship between the observed behavior 
and the theory is the same. The subclasses 



of each class are specified by the behaviors 
to be included and not by the supposed 
clinical meaning. It is the discrimination 
between kinds of behavior which is cen- 
tral, not the verbalized description or 
definition of the categories. Clinical hy- 
potheses were not being tested but were 
to be generated by the analysis. 

One further general point is in order 
here. The subclasses within each aspect 
are not intended to be scales. Some be- 
haviors are, of course, thought to be more 
therapeutic than others, but the subclasses 
contain qualitatively different kinds of 
behavior which may prove to be im- 
portant in their own right. 

A. Client Classification System 

1. Level of Expression. This aspect in- 
volves the level at which the client is deal- 
ing with and expressing whatever subject 
matter is under discussion. The subclasses 
are as follows: 

a. Analysis of action (including cogni- 
tive action): 

Statements placed here are those 
that attempt, either naively or with 
sophistication, to look beneath the 
surface, to analyze, interpret, ex- 
plain, classify, evaluate, or general- 
ize about action, including cognitive 
action. 

b. Analysis of feeling: 

The analysis of feeling category is 
somewhat similar to (a) above in 
its form; that is, the statements ana- 
lyze, interpret, explain, classify, 
evaluate, or generalize. The focus 
here, however, is on the feelings of 
the client as feelings, not as classes 
of behavior. 

c. 



Responsiveness is the category for 
statements that express directly a 
feeling or inner experience. The 
focus is on internal experience 
feelings, images, fantasy, impulses, 



NATURALISTIC DEFINITION OF VARIABLES 



191 



expressed or described more or less 
directly rather than being first ana- 
lyzed, conceptualized, or categorized. 
A statement that is rated here is one 
that could have been made only by 
the person himself or by someone 
who had put himself in the person's 
frame of reference. In R statements 
the client is seeking expression for 
something that is present "right 
now" even though it may be present 
in the past tense when the feeling 
first occurred in the past. 
2. Voice Qualities and Manner of 
Speaking. This aspect classifies client re- 
sponses according to qualities of voice 
inflection, pitch, pace, etc., without regard 
to the content of what is being said. It is 
a complex class, compounded of varying 
degrees of three different qualities: (a) 
amount of energy in the voice; (b) the 
direction in which the energy is turned; 
(c) whether the energy is controlled or 
discharged. For the training of judges, 
verbal descriptions of subclasses are sup- 
plemented by taped examples. 

a. Emotional: 

Responses placed here have a high 
energy level, but the energy tends 
to overflow into discharge rather 
than being used in a controlled way. 
The energy seems to overflow from 
within rather than being aimed to- 
ward the outside world. The voice 
breaks, trembles, is choked with 
crying, expressed discharge of acute 
tension, etc. 

b. Focused: 

Responses placed here have high 
energy, but the energy is used in a 
controlled problem - solving way 
rather than being discharged. The 
voice gives an impression of ponder- 
ing or exploration. The energy 
seems to be turned inward rather 
than being propelled outward. 
Speech is characterized by hesita- 
tions and irregularities of pace. 



There is little fluctuation in pitch 
of voice, but great irregularities in 
stress of syllables. 

c. Externalizing: 

Responses placed here are character- 
ized by fairly high energy, which is 
directed outward, seemingly toward 
having some effect on the outside 
world. It is characterized by a soap- 
box quality, in the sense of having a 
cadence or rhythmic pattern, as if 
the grooves were already on the 
disk and the record only had to be 
set going. The speech pattern is 
much smoother than in (b) above, 
with emphatic though often me- 
chanical inflection, together with a 
fairly wide range of pitch. 

d. Limited: 

Responses placed here are character- 
ized by low energy used in a matter- 
of-fact, even incidental tone. It is 
clearly a communication to the 
therapist, but it is not clearly direc- 
tional in the sense of (b) or (). 
The pace is even and relatively un- 
stressed. 

3. Quality of Participation. This aspect 
concerns the participation of the client in 
whatever he is discussing. 

a. Participating: 

This includes responses in which the 
client is a participator in whatever 
he is discussing, even though he may 
not be the prime mover in the 
action. 

b. Observing: 

The client is on the sidelines as an 
observer of the scene, rather than 
being an integral part of the scene. 
Statements in which the self is men- 
tioned only as being an observer of 
the scene, and statements referring 
to self only implicitly are rated here 
as well as statements completely un- 
related to the self. 
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B. Therapist Classification System 

1. P rashness of Words and Combina- 
tions. The most highly connotative lan- 
guage possible seems to be poetic, meta- 
phorical language in which much sensory 
imagery is used. This does not include 
analogy where the emphasis is on the iso- 
morphism of the two experiences, but 
rather the use of metaphor which adds 
vividness and color to the primary experi- 
ence. This main class contains five sub- 
classes. 

a. Responses placed here are those 
which present rather vivid meta- 
phors, having a high degree of 
imagery. This does not include state- 
ments of analogy but, rather, re- 
sponses having a strong picture- 
building character. The imagery is 
most often visual or auditory, but it 
may also be kinesthetic 

b. Responses placed here contain one 
or more fresh, colorful words or 
combinations, often of a sensory 
character. The words may carry 
images in themselves, but the total 
response does not have the vivid, 
picture character of (a). 

c. Responses rated here have an over- 
all punchy, stimulating character, 
but are without the use of unusually 
fresh sensory words or images. This 
may involve unique phrasing, juxta- 
position, or sounds or combinations 
of sounds. 

e. Responses placed here consist of 
commonplace expressions. The 
words and phrases, as well as the 
general structure of the response 
have an everyday, garden-variety 
quality. 

/. Responses placed here are empty or 
formalized. Generally there is an 
absence of denotative reference, 
which may be formalized or simply 
contentless. 

2. Voice Quality. Although interper- 
sonal anxiety is presumably cut down by 



the fact that the therapist stays within the 
frame of reference of the client, therapy 
is essentially an interpersonal process. 
There must be a real person for the client 
to encounter. If the client gets back his 
own messages from the therapist with 
nothing coming from him as a person, it 
can become like a stimulus deprivation 
experiment. This dimension is addressed 
to the question of how much the thera- 
pist's voice is bringing to the therapy situ- 
ation. Is he actually bringing something 
as a person, something that provides or 
generates new interpersonal experience 
for the client? Is he simply "present and 
accounted for"? Or is he actually remov- 
ing something from the situation, through 
dullness, weakness, or through empty and 
forced attempts to be something which at 
that moment he isn't? This class contains 
seven subclasses. 

a. Here the voice brings to life the 
feelings of the client fear, anger, 
pleasure, etc., but not to the extent 
of losing himself in the emotion; 
that is, there is control rather than 
overflow of energy. There is a good 
deal of energy present. 

b. Here again there is high energy in 
the therapist's voice, but it is char- 
acterized not by emotion but by 
vigor, confidence, warmth, etc. 

c. The therapist's voice has high 
energy, used in a controlled, prob- 
lem solving way. It is characterized 
by a pondering, exploring quality. 
There is unevenness of inflection 
and often hesitation, but not the 
hesitation of indecisiveness. The 
response may end on a questioning 
note, but not on a vague or weak 
one. 

d. The voice carries a note of newness 
or closure just arrived at, the inter- 
est of something newly seen or seen 
a different way. There tends to be a 
higher pitch and a rising energy 
level. 
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e. There is a moderate amount of 
energy, expressed in a serious but 
only moderately inflected voice. The 
inflection is natural, though with 
more seriousness and less animation 
than in many conversations. 
/. There is high energy present, but 
the words are accented for effect 
rather than for spontaneous mean- 
ing. It may take the form of a slight 
cadence or like an actor reading 
lines. The thing to watch for is the 
shifting of accent from the location 
of natural meaning. 
g. This subclass resembles (/) above 
except that energy is low. A ca- 
denced or singsong quality predomi- 
nates. They have the sound of a 
preformed pattern in which mean- 
ing is secondary. 

h. Very little energy is present. The 
response sounds thin, wispy or 
breathless, as if the therapist would 
run out of energy before the re- 
sponse was finished. The sentences 
are comparatively uninflected. 
3. Functional Level of Response. This 
dimension is more complexly determined 
than are the other two. While we think 
that the concept of stimulus hunger as a 
basic drive is a crucial one in therapy, 
there are clearly other aspects that inter- 
act with or channel it. When one reads 
Greek drama, for instance, there can be a 
tremendous arousal of new experience, 
and as has been repeatedly recognized, 
one can feel intense catharsis. Neverthe- 
less, there are ingredients missing that are 
present in psychotherapy. One such essen- 
tial ingredient is the self -directed search 
for the idiosyncratic "meaning" or impact 
of one's own inner experience. 

Once aroused, these experiences must 
be focused on and experienced out to the 
very edges, if their shape is to be spread 
out before one, and made usable for re- 
organization. 

This class, then, has to do with the 



functional level of the therapist's response. 
We distinguish seven subclasses or levels. 

a. The first distinction is between a 
focus outside or inside the client. 
Although these responses are within 
the frame of reference of the client, 
the therapist is joining with the 
client in focusing on something that 
is outside. Responses may refer to 
the client and still be placed here, 
if it is a behavioral description of 
oneself as an external object. 

b. Responses placed in this second sub- 
class focus on the client's concept of 
himself and of the stimuli immedi- 
ately impinging on him. These re- 
sponses are certainly "inside** the 
client, since the client and the 
therapist are examining the client's 
own motivations, attitudes, percep- 
tions, and behavior. On the other 
hand, they contain a kind of objecti- 
fication, in which, momentarily at 
least, there is a two-part division of 
the self, with one part observing the 
other. This is in contrast to the 
"feeling" categories where the focus 
is on "how I feel," "what's it like 
right now." 

c. Responses placed here concern feel- 
ings, but the feelings are being 
labeled rather than explored. The 
emphasis is on finding a name for it, 
classifying it, rather than on explor- 
ing "what is it like inside?" For 
instance, a therapist who responds 
"you are angry" is summing a whole 
range of experience under this com- 
mon label. It leaves out the whole 
range of inner experience that 
makes one person's experience of 
anger so different from that of an- 
other. 

d. This subclass includes responses in 
which the therapist is expressing 
feeling or inner experience without 
using feeling or sensory words. He 
is attempting to bring it alive by 
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verbally acting it out. Speaking in a 
slightly different context, we could 
say that the therapist is attempting 
to get into the slipstream of the 
person's inner awareness without 
organizing it or making it static. It 
has the fluid quality of a momentary 
impression or free association. 

e. Responses placed here attempt to 
explore the stimulus for a feeling. 
It is not an attempt to pin down 
causality, but to explore the personal 
impact of the stimulus. 

/. In this subclass and the one that 
follows, the therapist is attempting 
to help the client to explore the 
idiosyncratic edges of his own feel- 
ings. Responses placed in this sub- 
class involved the sensing edge of 
the client's inner awareness, re- 
sponding to the flavor of the experi- 
ence. They need not be literally 
sensory, but may involve images, 
etc, but they tend to involve "body 
language." 

g. Responses placed here are on the 
impulse edge of inner awareness. 
They involve an outward push, what 
the client would like to do right 
then. They are on a primitive im- 
pulse level, rather than having a 
considered ego-integrated quality. 

DATA ANALYSIS 

The study to be reported consists of 
the application of classification systems 
to the behavior of clients and therapists. 
Our strategy was to apply and analyze 
separately the classification systems for 
client and therapist, treating the responses 
of client and therapist separately, and then 
to treat each dyad of client-therapist re- 
sponse as a unit Treating the dyads of 
responses as units results in an analysis of 
response by response interaction between 
client and therapist. 

The experimental population of clients 
consisted of 24 completed cases selected 



from a larger block of research cases. All 
cases were treated by therapists with a 
Rogerian orientation and were selected so 
as to provide an equal number of tape 
recorded interviews from cases rated as 
success and failure cases by their thera- 
pists. A group of cases rated at the mean 
of the nine-point scale used in rating were 
also included in the study. Length of 
treatment was balanced among the cases, 
and four attrition cases (discontinuing 
therapy before the sixth interview) were 
included among the failure cases. 

The interviews selected for analysis 
were the second and next-to-last inter- 
views, this selection being based on a 
desire to minimize "hello-goodby" effects. 
Only the second interviews were used for 
the attrition cases. Once the interviews 
had been selected, they were divided into 
thirds, by time. Then ten successive re- 
sponses of client and therapist were taken 
from each third of the interview and 
classified. All classifications were based 
on listening to tapes; transcripts were not 
used. The unit of response used was what 
we conceived to be a "natural" or func- 
tional unit. That is, the response of the 
client was what was said between two 
therapist responses, and the response of 
the therapist was what was said between 
two client responses. 

Reliability of classification was con- 
trolled by training. Judges were given 
written specifications of the classification 
systems and taped samples of responses 
with their classification. The judges were 
trained until they reached a standard set 
by the investigators. Periodically, the 
judges were required to classify a stand- 
ard set of responses taped onto "drift" 
records. The drift records were designed 
to insure that standards of judgment did 
not change. 

After the client responses had been 
classified, they were brought into the 
standard form of the matrix S. The data 
matrix S, with unit and zero entries, show- 
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ing just what each client did and did not 
do in terms of the classification system 
employed was 720 X 44, with n = 30, 
q =24, and t = 44. In the final standard 
form, then, the classification system had 
24 independent, mutually exclusive sub- 
classes. 

The matrix 1/n S' S (Butler, Wagstaff, 
Rice, & Counts, I960) was used in the 
analysis. The elements of this matrix are 
a measure of the similarity between inter- 
views on a scale from zero to unity. In 
this study sequence within thirds of the 
interviews was not retained; only the 
sequence between thirds was retained. 
Thus a rearrangement of the S matrix 
was necessitated. The rearrangement was 
carried out according to the method out- 
lined in Wagstaff and Butler (1959). As 
a result, the final measure of similarity 
between interviews was based on a 
sequence of thirds of interviews rather 
than on a sequence of responses, one after 
another. 

The matrix of interview similarity is 
shown in Table 1 (see Wagstaff, 1959, 
p. 43). The matrix was factored by the 
multiple group method. Communalities 
used for the groups are given in the 
diagonals of Table 1. Communalities 
were estimated by taking the centroid of 
each group, using the highest off -diagonal 
value of the variables in each group in 
the diagonal. 

The factoring process was stopped 
when the sum of squares of the projec- 
tions on the first centroid vector, as shown 
in the factor matrix, was .97. Since this 
vector has unit communality and is con- 
tributed to by all dimensions, it seemed 
that the data were essentially accounted 
for. As a check, a sample of 150 residuals 
was computed. These had a mean of .02 
and a median of .018. Since the distribu- 
tion was reasonably symmetrical, no fur- 
ther basis vectors were extracted. 

Table 2 shows the matrix of the cosines 
of the angular separation between the 



vectors of the simple basis. The rank dif- 
ferential is .07 and the index of internal 
productivity is .89. Thus we conclude 
that the classification system has con- 
siderable internal productivity. 

After the simple basis had been deter- 
mined, the matrix of projections of the 
interviews on the orthogonal basis best 
fitting the simple basis was found by the 
method described in Butler, Wagstaff, 
Rice, and Counts (I960). It should be 
noted that these loadings of necessity 
closely resemble those for the correspond- 
ing matrix of projections onto the vectors 
of the simple basis. The matrix of the 
projections onto the orthogonal factors 
approximating the simple basis is shown 
in Table 3. The second interviews are 
the odd-numbered loadings, and the suc- 
ceeding even-numbered loadings are the 
next- to-last interviews. Interviews 41, 42, 
43, and 44 are the second interviews of 
the attrition cases for which there were no 
late interviews to classify. The loadings 
of the interviews on the basis vectors 
represent the similarity between the 
actual interviews and mathematically de- 
fined "hypothetical interviews." 

In obtaining characterizations of the 
mathematically defined interviews, those 
interviews having loadings of .40 or more 
on a given basis vector with no other 
loading greater than .20 were selected. 
Then those response classifications ap- 
pearing most frequently in the interviews 
were selected until there were ten re- 
sponse ratings for each third of the inter- 
view. It will be remembered that there 
were ten responses in each section of the 
interview. Table 4 shows the frequency 
of responses classified within each class 
for each basis vector at the first, second, 
and third sections of the interviews. 

The four interviews serving as the base 
for the characterization of the first factor 
are 2, 9, 10, and 6. The characteristic be- 
haviors are such that the client almost 
always includes himself in what he is 
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expressing rather than expressing himself 
as an observer. The typical response is 
that in which the client is analysing feel- 
ings having relevance to him, sometimes 
his voice being expressive of feeling. Even 
when communicating about ideas or ac- 



tions the client expresses himself in a 
focused, energetic manner. In roughly 
one-fourth of his responses, the Factor I 
client expresses feelings or experiences 
quite directly with a voice quality which 
is focused or emotional. The direct ver- 
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balization of experience accompanied by 
the expression of emotion in the voice is 
found only in the Factor I client. 

Time trends within the interview are 
not prominent for Factor I clients. There 
is a slight increase in responsiveness and 
emotional involvement and also some in- 
crease in externalizing and observing re- 
sponses. 

Factor II characterizations were based 
on Interviews 26, 41, 37, 3, 11, and 19- 
Here nearly all of the client responses are 
classified as participating. However, re- 
sponsiveness, the direct expression of 
feeling is absent, and analysis of actions 
and ideas are present almost to the ex- 
clusion of analysis of feelings. In the 
involvement class, over two-thirds of the 
responses were classified as showing a low 
energy level, the voice sounding rather 
matter-of-factly serious and lacking in 
searching or exploring quality. 

Sequence effects for Factor II show a 
definite trend for the involvement class, 
with an increase in focused or exploring 

Table 1 



behavior during the hour. Externalizing 
responses all appear in the last third of 
the hour with a decrease in responses 
showing limited energy output. Clearly 
the clients typically leave the hour show- 
ing more energy output than at the be- 
ginning. The outstanding characteristic 
seems to be the low energy level of re- 
sponses throughout most of the interview 
with some, but not much, increase as the 
hour progresses. 

The eight interviews upon which the 
characterization of Factor III depends are 
30, 23, 29, 35, 40, 4, 32, and 43. About 
half of the responses have a participating 
quality and about half have an observing 
quality. 

In the level of expression class the 
client, in 90% of his responses, is discuss- 
ing ideas or actions; he never expresses 
feelings directly. In those responses in 
which feelings are discussed in relation 
to self, the voice has an externalizing 
rather than an exploring quality. In fact, 
in most responses, the client sounds as 
continued 
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a Decimal points axe omitted. 

b Communalities are given only for interviews used in groups. 
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TABLE 2 

COSINES OF ANGLES OF VECTORS 
OF THE SIMPLE BASIS* 
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* Decimal points are omitted. 

though he were dramatizing or making 
a speech (externalizing). This persistent- 
ly externalizing voice quality is the out- 
standing characteristic of clients having 
high loadings on the third basis vector. 

In comparing the clients whose inter- 
views define the three factors, there are 
well-defined similarities and differences. 
The clients loaded on the first two factors 
are usually participants rather than ob- 
servers of the scene. However, on Factor 
I, the client is talking about his feelings 
with high energy, while on Factor II the 
client is operating on a low energy level 
about his ideas or some activity in which 
he is participating. The voice of the 
Factor II client lacks force and does not 
have an exploring quality like that of the 
Factor I client. The Factor III client may 
have high energy output but he is exter- 
nalizing; he is not a participant like the 
Factor I and Factor II clients. 

In the level of expression class, the 
Factor II and Factor III clients seem very 
similar. Both exhibit practically no dis- 
cussion of feelings and experiences. How- 
ever, the Factor II client is communicat- 
ing about his own actions or ideas, 
whereas the Factor III client is frequently 
talking about events completely outside 
himself. Moreover, the Factor III client 
has high energy output; the Factor II 
client a low one. 

In summary, it might be said that the 
Factor I behavior was more optimal for 
therapy than the other types. The client's 
energy, openness of expression, and abil- 
ity to directly communicate experience 



seem to point toward the likelihood of 
favorable personal reorganization. Factor 
II behavior seems more questionable. On 
the one hand the client communicates 
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relevant material in a somewhat expres- 
sive way, but some of the important in- 
gredients of expressiveness seem to be 
missing. Factor III behavior by contrast 
seems more unequivocal. The self-avoid- 
ant, nonparticipating, describing, verbal 
behavior with its externalizing quality, 
seems unlikely to be associated with 
favorable outcomes in therapy. Thus the 
type of behavior shown by the factorial 
structure seems to have clear implications 
for therapeutic outcome. 

In order to check the plausibility of the 
inferences drawn from the factorial struc- 
ture, the external productivity of the 
classification system was checked by way 
of the factorial structure. Rektionships 
of the factor loadings to the following 
external indices were found: 

a. Therapist experience 

b. Success rating by therapist 

c. Outcome rating by client 

d. Taylor Anxiety Scale 

e. Barron Ego Strength Scale 

The findings may be summarized as fol- 
lows: 

Factor I 

1. Excluding attrition cases, success- 
rated cases (ratings of 6 or above) tended 
to be higher on Factor I for the early in 



therapy interviews when compared with 
the nonsuccess cases (U test, .05 level). 

2. The late interviews of success-rated 
cases tended to be higher on Factor I 
than for nonsuccess-rated cases (U test, 
.025 level). 

3. The early interviews having load- 
ings of .40 or more on Factor I were suc- 
cess-rated cases. 

4. Of the seven failure-rated (ratings 
of 4 or below) cases, six had loadings of 
.20 or less on Factor I ( U test, .062 level) . 
The seventh case had a loading greater 
than .20 early in therapy, but the loading 
had decreased somewhat at the end of 
therapy. 

5. Clients of therapists with two or 
more years of experience tended to have 
higher loadings on Factor I than on Factor 
III for both early and late interviews (U 
test, .05 level) than did the clients of less 
experienced therapists. The same com- 
parison between Factor I and Factor II 
did not yield significant results. 

6. Client evaluation of outcome of 
therapy was not significantly related to 
loading of early interviews on Factor I 
(, = .05,N.S.). 

7. Client evaluation of outcome of 
therapy was not significantly related to 
loading of late interviews on Factor I 
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(p = .27, .05 level = .38). Rank cor- 
relation between correlations of Q sorts 
(self -sort and ideal common factor) was 
not significantly related to loading on 
Factor I for early and late interviews al- 
though in the expected direction early in 
therapy ( .28) and although the change 
was in the expected direction. 

8. Change in favorable self-descrip- 
tion as revealed by correlations between 
self Q sorts before and after therapy had 
significant rank order correlations, with 
rank of loading on Factor I for early but 
not for late interviews (p = .46 and ,30, 
respectively, .05 level = .38). 

9. Decrease in anxiety score on the 
Taylor Anxiety Scale had a significant 
rank correlation with rank of loading on 
early Factor I interviews but not for late 
Factor I interviews, (/o = .47 and .13 re- 
spectively). 

10. For clients with pure loadings on 
Factor I and pure loadings on Factor III, 
the difference between means on the Bar- 
ron score was significant in favor of the 
Factor I clients (U test, significance 
level = .033). The comparison between 
Factor I and Factor II clients did not 
yield significant results. 

Although some of the results on Factor 
I are not in the expected direction, the 
positive results are consistent with the 
factor characterization. No unexpected 
findings in the sense of the opposite of 
expectation occurred. It can be said, there- 
fore, that the characterization of Factor I 
is consistent with the definite findings 
and not inconsistent with the nondefinite 
findings. To this extent the characteriza- 
tion of Factor I is supported by data ex- 
trinsic to the classification system used. 

Factor II 

1. In comparing ranks of loadings on 
late and early interviews of the clients, 
no significant difference between early 
and late interviews was found (Wilcoxon 
test). 

2. When loadings of the kte inter- 



views of clients loaded on Factor II were 
compared on the basis of success ratings, 
partially successful (ratings of 5) against 
all other ratings, the combined success 
and failure ratings, it was found that the 
mean rank of the clients with ratings of 
5 was higher than the mean for clients 
with other ratings (U test, significance 
level = .025). When the clients with 
ratings of 5 were compared separately 
with those clients whose ratings were 
above 5 and below 5 respectively, the 
mean differences were still significant at 
the .025 and the .055 levels, respectively. 
Thus Factor II seems to be characteristic 
of late interviews of partially successful 
cases. 

3. Therapist experience was not re- 
lated to factor loadings on Factor II. 

4. Rank order correlation of loading 
on Factor II with client evaluation of out- 
come was .42 and .18 for early and late 
interviews respectively. The first correla- 
tion is significant at the .05 level. 

5. Rank order correlation between 
correlations of Q sorts on self and the 
ideal factor were not significant for early 
or late interviews. 

6. Rank order correlations between 
favorable change on pretherapy and post- 
therapy self Q sorts for early and late in- 
terviews were not significant and in fact 
were practically zero. 

7. Rank order correlations between 
loadings on Factor II and change in 
Taylor Anxiety score, pretherapy Taylor 
score and posttherapy Taylor score were 
not significant. 

8. Rank order correlations between 
loadings on Factor II and change in 
Barron Ego Strength score, pretherapy 
Ego-Strength score, and posttherapy ego 
strength score were not significant. 

Factor III 

1. Early interviews of completed fail- 
ure cases were higher on Factor III than 
early interviews of success cases (U test 
significance level = .05). 
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2. Late interviews of failure cases 
were higher on Factor III than late inter- 
views of other cases (U test significance 
level = .01). 

3. Success cases had lower loadings on 
Factor III late in therapy than they had 
early in therapy (Wilcoxon test, signifi- 
cance level .025). 

4. All failure-rated cases had substan- 
tial loadings on Factor III for their late 
interviews. The lowest loading was .34, 
the remaining six had loadings greater 
than .40. 

5. Late interviews of clients having 
experienced therapists had lower loadings 
on Factor III than late interviews of cli- 
ents having the less experienced thera- 
pists (U test, significance level = .025). 
This is the opposite of the finding for 
Factor I. 

6. Rank order correlation between cli- 
ent evaluation of outcome and rank of 
loading on Factor III was -.54 for early 
interviews and .31 for late interviews. 
The first correlation is significant at the 
.05 level; the second, not. 

7. Rank correlation between loading 
on Factor III and correlation between self 
Q sorts and ideal factor was not signifi- 
cant. 

8. Rank of loading on Factor III was 
not correlated significantly with rank of 
pretherapy score, posttherapy score, or 
change in score on the Taylor Anxiety 
Scale for early and late interviews. 

9. The rank correlation between load- 
ings on Factor III for late interviews and 
Barron Ego-Strength score was -.56. This 
is significant at the .01 level. For the 
early interviews the correlation was not 
significant. 

The findings on the various measures 
for the three factors found might be sum- 
marized as follows: 

1. Clients showing Factor I behavior 
early in therapy were more likely to be 
rated as success than as failure cases. It 
is even more likely when the Factor I be- 



havior appears late in therapy. When 
Factor II behavior appears early in ther- 
apy it could not be predicted how the case 
would turn out. Clients at all levels of 
success, therapist experience, and length 
of case appear in Factor II early in ther- 
apy. However, by the end of therapy, 
Factor II behavior is characteristic only 
of partially successful cases. Clients with 
Factor III behavior early in therapy tend 
to be failure cases. This relationship holds 
for late therapy cases. However, two long 
success-rated cases both score on Factor 
III and had high loadings on it at the 
end of therapy. These cases had therapists 
in the less experienced group. 

2. Clients on Factor I tended to have 
more experienced therapists; on Factor 
III, less experienced. Experience was not 
related to Factor II. 

3. Client evaluation of outcome of 
therapy is related positively to Factor II 
(early interviews only) and negatively to 
Factor III (early interviews only). It is 
not related to Factor I. 

4. Correlations of self Q sorts with an 
ideal factor derived from another sample 
of clients were not related to magnitude 
of factor loadings on Factors I, II, and III. 

5. Favorable change in self -descrip- 
tion as assessed by correlations between 
pretherapy and posttherapy self Q sorts 
was correlated positively with magnitude 
of loading on Factor I (early interviews 
only). Favorable change was not signifi- 
cantly related to magnitude of loading on 
Factors II and III. 

6. Decrease in anxiety as measured by 
change in score from pretherapy to post- 
therapy was positively correlated with 
magnitude of loading on Factor I (early 
interviews only). Decrease of anxiety and 
level of anxiety was not related to size of 
loadings on Factors II and III. 

7. Ego strength, measured by the 
Barron scale at posttherapy was positively 
correlated with Factor I behavior (late 
interviews only) and negatively with 
Factor III behavior (late interviews 
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only). Ego-strength change was not sig- 
nificantly correlated with loadings on any 
factor. However, the difference between 
means of Ego-strength scores of clients 
pure on Factors I and III was significant at 
the .033 level, with the Factor I clients 
having the higher Ego-strength score. 

In comparing the factors each with the 
other, it seems that the factors represent 
classes of behavior which can be arranged 
on a continuum of expressiveness of lin- 
guistic behavior in the Order I, II, III and 
that the placement of clients on the con- 
tinuum is related to outcome of therapy 
from the vantage point of the therapist, 
of the client, and of test instruments 
which are essentially diagnostic in nature. 
The degree of expressiveness is also re- 
lated to therapist experience which sug- 
gests, not so much that it is important to 
control the experience variable in the 
study of therapy, but that the perform- 
ance of the therapist is the variable that 
should be experimentally controlled. Our 
findings allow us to state only that rela- 
tionships exist, not that they are causal. 
It is our hypothesis, nonetheless, that 
therapist expressiveness represents a set 
of causal influences affecting the process 
and outcome of therapy and that the more 
experienced therapists are more expres- 
sive than the less experienced. It should 
be noted, however, that expressiveness is 
a complex variable. For example, as the 
classification system shows, there are sev- 
eral ways in which a Factor I type client 
might be expressive, and thus distinctive- 
ly different kinds of behavior might yield 
the same score on an expressiveness con- 
tinuum. Whether these different expres- 
sive modes giving the same score might 
have the same effect, we do not know. 
The point, however, is that we have em- 
pirical leverage on the problem of defin- 
ing a variable, and the information at 
hand is that the variable might be very 
complex. 

At the time of writing, analysis of the 



therapists' responses in relation to the 
responses of the clients studied has not 
been completed. However, the dimension- 
ality of the therapists' responses, analyzed 
in the same fashion as those of the clients, 
has been found to be four. Data on three 
main classes of the therapist classification 
system have been studied in relation to 
the factor structure of the client's be- 
havior. These therapists' classes are Cate- 
gories 3, 1, and 2 of the classification 
system previously described in the section 
on Therapist Classification System. 

Table 5 shows the rank order correla- 
tions between combined frequencies of 
the subclasses of Therapist Classes 3, 1, 
and 2 judged to be optimal for therapy, 
and the magnitude of loading on Client 
Factor I, II, and III for early and late in- 
terviews considered separately. A corre- 
lation of .38 and above is significant at 
the .05 level. 

Table 5 shows rather clearly that the 
rank of the frequency of Categories 3, 1, 
and 2 of therapist responses is related 
positively to the rank of loading on Client 
Factor I. Thus the therapist behavior 
judged to be optimal tends to be asso- 
ciated with client behavior judged to be 
optimal. Since the therapists of clients 
loading high on Factor I tend to be among 
the more experienced, it seems we can say 
with a fair degree of confidence that the 
more experienced therapists tend to ex- 
hibit more of the behavior judged to be 
optimal, although the exact relationship 
has not yet been determined. The rela- 
tionships are higher for the early inter- 
views; why this should be is not apparent, 
although different alternatives could be 
advanced. 

On turning to consideration of Client 
Factor II, it is seen that the relationship 
between Factor II and therapist response 
is negative for Classes 3 and 1 and near 
zero for Category 2. It appears that with 
the passage of time, therapists with Factor 
II clients exhibit rektively more of the 
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optimal responses, particularly in the sub- 
categories of Category 1. However, this 
interpretation must be qualified to an un- 
known degree because some clients move 
from Factors I and III early in therapy to 
Factor II late in therapy. 

For Factor III the relationship with fre- 
quency of optimal therapist responses is 
negative for therapist Categories 3 and 2. 
For Category 1 the relationships are not 
significant although very nearly so late in 
therapy. For Categories 1 and 3, the 
magnitude of the relationship increases 
as therapy goes on. At the end of therapy, 
optimal therapist responses to Factor III 
clients tend to decrease. Since Factor III 
clients tend to be unsuccessful cases and 
since their therapists tend to be relatively 
inexperienced, it may be that in-therapy 
behavior of Factor III clients militates 
against the appearance of optimal re- 
sponses in their therapists. This is espe- 
cially suggested by the results on therapist 
Category 2, voice quality, where the cor- 
relations are high negative. 

The results of the analysis of client and 
therapist responses, as viewed through 
the perspectives of the classification sys- 
tems employed, suggest that there are 



causal relationships between client ex- 
pressiveness, therapist expressiveness, the 
process of psychotherapy, and the out- 
comes of psychotherapy. We are of the 
opinion that after the therapist responses 
have been analyzed in detail and after the 
dyads of client-therapist responses have 
been analyzed, we will be traveling on 
two roads simultaneously. One road will, 
we think, lead us to increasingly precise 
definitions of expressiveness variables in 
behavioral terms. The other will lead us 
to experimental modification of the ther- 
apy hour. As a matter of fact, we already 
have some ideas on how to modify ther- 
apy hours and have put some of them into 
effect with results which we find to be 
provocative. 

What we have tried to present to this 
conference is a viewpoint on naturalistic 
research which has led us quite naturally 
to a mathematical counterpart of our in- 
tuitive ideas. The mathematical model 
results in behavior cksses or classes of 
individuals derived from behavior. We 
regard these classes of behavior or of in- 
dividuals as being the possible precursors 
of meaningful variables related to client 
and therapist behavior and as being 



TABLE 5 

RANK ORDER CORRELATIONS 

(Therapist Response Categories and Client Factor Loadings 
For Early Therapy and Late Therapy Interviews*) 



Therapist Classes 


3 1 


2 


Client Factor 


E L E L 


E L 


Factor I 


E 70 57 
L 40 33 


64 
60 


Factor II 


E -31 -68 
L -28 -07 


14 
04 


Factor III 


E -27 05 
L -40 -37 


-76 
-60 


* Decimal points are omitted. 
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promising precursors when external pro- 
ductivity of the classification system has 
been demonstrated. Our aim in present- 
ing a specimen analysis has been to show 
that naturalistic investigation can be ob- 
jective, can be operational, and can lead 
to clinically meaningful results. The speci- 
men investigation presented has not been 
a complete one. A complete investigation 
would include the isolation of classes of 
clients and classes of therapists based on 
separate analyses of their behaviors, and 
cksses based on client-therapist dyads for 
both row and column ("trait" and "type") 
analyses of the data of classification ar- 
ranged in the standard form of the data 
matrix S. 
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Character Style and Anxiety Tolerance: 
A Study in Intrapsychic Change 1 
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The gradually unfolding nature of the 
psychotherapeutic and psychoanalytic 
process looked at from one highly re- 
stricted point of view can be understood as 
the inexorable disclosure by the patient of 
secrets; secrets he keeps from himself as 
well as from others by means of the com- 
plex, intricate, and hidden methods whose 
understanding forms the stock in trade of 
the psychotherapist. Research into the 
processes and outcomes of psychotherapy 
or into any other natural or artificial phe- 
nomena, can also be looked at as a struggle 
on the part of the researcher to find ways 
which make it possible for the objects 
of his research to disclose their secrets. 
Just as the psychotherapist harbors within 
himself secret thoughts and feelings with 
regard to his patient, his relationship to 
the patient, and the process they are en- 
gaging in, all of which are traditionally 
viewed under the heading of counter- 
transference, so the researcher keeps hid- 
den, both from himself and his scientific 

x The work of the Psychotherapy Project of 
The Menninger Foundation has been generous- 
ly supported, initially by the Foundations' Fund 
for Research in Psychiatry, and subsequently by 
the Ford Foundation. 

This report represents, we feel, a closer than 
usual collaboration. Our ideas are the product 
of truly mutual participation in a shared effort. 

We wish to acknowledge the assistance of 
Frederick Hacker, M.D., and Rene Spitz, M.D. 
Both men generously gave us time to discuss 
with them the ideas embodied in this paper. 

We are especially indebted to Robert Wal- 
lerstein, M.D., co-chairman of our project, for 
his consistent encouragement and help in the 
task of translating a clinical impression (shared 
by himself) concerning the significance of anx- 
iety tolerance, into the form and structure of 
the present paper. 



public, ideas and feelings in regard to the 
research enterprise. The influence upon 
the treatment of the process and progress 
notes the therapist prepares and the case 
presentations he agrees to participate in 
is commonly acknowledged to be signi- 
ficant (Ekstein & Wallerstein, 1958). 

The foregoing considerations are offer- 
ed by way of preparation for our dis- 
closure of the secret that the invitation to 
participate in this conference is playing 
a role in the research endeavor in which 
we are engaged. It offers us the opportun- 
ity to begin to explore and to share with 
you a way of ordering the almost over- 
whelming abundance of data we have col- 
lected. 

We have had, from the inception of 
the data gathering, predetermined ways of 
handling our data which we hope will 
compel them to yield up some of their 
hidden implications. All of this has been 
previously described (Wallerstein, Rob- 
bins, Sargent, & Luborsky, 1956) and we 
shall presume your familiarity with it. 
Briefly stated, our project has already ar- 
rived at two ways of treating the data which 
comprise separate and independent re- 
search approaches: (a) the Prediction 
Study, in which clinicians predict the 
course and outcome of psychotherapy on 
the basis of their initial pretherapy ex- 
aminations; the predictions then being 
formalized and the precise nature of the 
evidence set down in advance for the veri- 
fication or invalidation of such predic- 
tions; and () the Paired Comparisons 
Study, which is designed to enable us to 
arrive at interindividual comparisons of 
patients, of psychotherapeutic modalities, 
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and of life-situational contexts. Brief re- 
flection on the nature of these two ways of 
organizing our data will reveal something 
of their clinical "naturalness." The thera- 
pist beginning treatment with his patient 
implicitly makes predictions and sets be- 
fore himself anticipations as his growing 
understanding of his patient becomes the 
guide to future therapeutic interventions 
and hoped-for outcomes. Thus, a prediction 
study (even with the rigorous rules of 
evidence imposed by our design) is a con- 
genial research extension of an essentially 
clinical attitude. Similarly, the method of 
paired comparisons represents, in a more 
rigorous and specific way, a manner of 
thinking that clinicians feel is also com- 
patible with their predetermined ways of 
organizing their thoughts. Again, for 
example, the clinician considering his new 
patient will often compare him with 
others who are in some ways similar to 
and in other ways different from this in- 
dividual. Moreover, he will do this with 
respect to certain selected variables im- 
portant to his theoretical framework. In- 
deed, this implicit and not necessarily con- 
scious sifting through of his previous ex- 
periences with other patients forms, of 
course, one method by which the clinician 
brings to bear upon the current clinical 
situation his accumulated skill and knowl- 
edge. 

In both methods, however, the focus of 
the clinician's attention remains on the 
individual patient, even though both 
methods can be extended in a research de- 
sign to yield, with appropriate statistical 
treatment, clinically meaningful group- 
ings of patients. 

There is, however, another step to be 
taken, and one which is approached by the 
clinician with considerable reluctance. 
Influenced both by personal preference 
and training to direct his attention to the 
individual patient, the clinician ap- 
proaches with wariness the problem of 
assigning individuals to groups on the 



basis of common characteristics. He has 
learned to be skeptical of diagnostic labels; 
he has become mistrustful of global clas- 
sifications of individuals into groups like 
"improved and unimproved" at the ter- 
mination of treatment; he recognizes the 
wide range of individual difference that 
characterizes most clinically derived group- 
ings. We thus share with you another 
secret, our own initial reluctance, since we 
are clinicians as well as researchers, to 
make statements about groups rather than 
about individual patients in our project. 
At the same time, we view the present 
paper as a way of exploring the possibility 
of utilizing one of our selected patient 
variables, anxiety tolerance, and attempt- 
ing to see how far one can go in making 
clinically meaningful statements about 
groups of patients classified according to 
change in this one dimension of intra- 
psychic functioning. 

We should like next to touch upon the 
way in which psychological tests are used 
in our project. While we cannot in this 
paper give any complete account of our 
psychological test procedures and ration- 
ale, we should emphasize that the test bat- 
tery is in all respects identical with that 
used in our day-to-day clinical work at 
The Menninger Foundation. We include 
the Wechsler-Bellevue, Rorschach, Word 
Association, Thematic Apperception Test, 
and a test of concept formation. Detailed 
explications of our procedures and of our 
rationale for test interpretation have been 
set forth elsewhere (Ehrenreich & Siegal, 
1958; Siegal & Ehrenreich, 1959; Siegal, 
Rosen, & Ehrenreich, I960). 

As originally conceived, the Psychol- 
ogical Test Study of our project patients 
was to be an independent study parallel 
with the nontest, "clinical" study of the 
patient and the therapy. The tests were to 
be kept independent of other sources of 
information. That is, on the basis solely 
of psychological test data and inferences 
derived from these, we anticipated that 
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we too would utilize the methods of the 
Prediction Study and the methods of the 
Paired Comparisons Study. For various 
reasons, this plan will probably not prove 
feasible. We have neither the manpower 
nor the independence from other lines of 
investigation to carry this through (al- 
though we probably shall be able to com- 
plete a prediction study of a somewhat 
more limited kind than the project as a 
whole is conducting) . True to the clinical 
spirit of our research, our psychiatric and 
psychological colleagues, attempting to 
assess intrapsychic factors within the pa- 
tient and to predict course and outcome 
of psychotherapy, have been unwilling to 
do so without the benefit of psychological 
test reports. To separate testing and clini- 
cal psychiatric investigation in our setting 
would be clinically "unnatural." This 
has necessitated making test-retest com- 
parisons on terminated patients, in some 
cases before we have been able to make 
independent predictions of psychotherapy 
course and outcome. It is our plan, if time 
permits, to make predictions on some of 
the patients before termination occurs, at 
a point at which we still know nothing 
about the psychotherapy. We have then, 
as data, 18 test-retest reports on patients 
who have currently come to termination. 
(There are 42 patients in the study of 
whom 26 have terminated psychotherapy.) 
These reports vary in the amount of time 
which has been devoted to their prepara- 
tion and in the explicitness and faithful- 
ness with which they follow the outline 
of variables assessed at three points in 
time, initial, termination, and follow-up 
(Wallerstein et al., 1956). Some of them 
follow this form exactly, assessing each of 
the variables we feel we can assess from 
psychological tests alone; and some, on the 
other hand, are much briefer attempts to 
summarize the significant changes in the 
psychological test picture referring expli- 
citly to some but not all of the variables. 
We are utilizing the occasion for this 
paper to begin the search for clinical ways 



of examining the data which will make 
it possible to arrive at some more or less 
generalizable understanding of our cases. 
We started, then, simply by inspecting the 
data at our disposal at this stage of the 
research. And here we must introduce the 
notion that we consider our data to be 
the inferences drawn from the psycho- 
logical test protocols. Neither the patients' 
responses nor the scores we attach to these 
responses are the object of our research 
scrutiny. This is, we realize, rather differ- 
ent from the usual approach to psycho- 
logical test-retest studies in psychotherapy 
research. It corresponds to Sargent's idea 
(1961) explicitly accepted and utilized 
by the project, that the essential data of 
the project as a whole are not the ob- 
servations made by the psychiatrist or 
social worker or psychologist who ex- 
amines the patient, but rather the infer- 
ences and predictions he arrives at after 
he has gone through the process of clini- 
cal inference. We believe this is the hard- 
headed, realistic approach, since it is evi- 
dent and has been pointed out many times 
that observation is inevitably selective and 
the very act of observing includes the 
drawing of inferences. Of course, this 
point is arguable, and it is not our inten- 
tion here to introduce considerations of 
epistemological theory. We are convinced, 
however, that before one can profitably 
utilize test responses and scores he must 
first assign meaning to them in accord 
with the theory of personality to which 
he is committed. The same score, the same 
response, the same verbalization, the same 
percept represents and conveys different 
meanings depending on the personality, 
the test context in which it appears, and 
the theoretical framework within which 
these data are conceptualized. The same 
intrapsychic process or entity or variable 
manifests itself in different ways in dif- 
ferent patients. Anxiety, or ego strength, 
or insight, or psychological-mindedness 
shows in tests in a multiplicity of ways. 
Our preference is not to look for some 
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particular test indication of insight, for 
example, but rather to make whatever in- 
ferences we can about the intrapsychic 
variable we are interested in and to com- 
pare this assessment with our assessment 
of the same variable for some other indi- 
vidual. We feel we may compare patients 
in terms of intrapsychic variables much 
more accurately, readily, and meaningfully 
than we can in terms of test responses or 
test scores. In beginning to examine our 
data, then, we start with the inferences 
we have drawn, as stated in the test-retest 
reports. 

Turning to these in preparation for 
writing this paper it became evident to 
us that we might have commented on 
changes in insight in one patient in much 
greater detail than in another, upon 
changes in the way guilt manifests itself 
in one patient but not in another, etc. 
This, as we explained in our introduc- 
tion, is a product of the necessity to in- 
tegrate our test studies with the other 
investigative approaches to the patient. 
One variable, however, upon which we 
commented in each case was anxiety toler- 
ance. Extracting from each report those 
statements relevant to the variable anxiety 
tolerance, we became aware of the impor- 
tance of this concept in our thinking. We 
began to notice the explicit and implicit 
connotations of high or low anxiety toler- 
ance in our clinical practice as well as our 
research reports. We began to think about 
the concept, its meaning, its history, its 
value, its unclarities. We began to won- 
<Jer: What does it mean if we say the 
patient's anxiety tolerance has increased 
or decreased? How is it possible to in- 
crease anxiety tolerance? What shifts, or 
changes or reorganizations in personality 
can bring this about? 

We propose to examine the changes 
which have taken place from pretherapy 
to posttherapy studies of 18 patients as 
reflected in psychological tests, from the 
restricted and limited point of view of 
anxiety tolerance. How can we concep- 



tualize changes in anxiety tolerance, and 
how far will this single concept take us 
in understanding what has changed within 
the patient and how this change has come 
about? 

Anxiety tolerance was defined for the 
project by Wallerstein and Robbins 
( Wallerstein et al., 1956) as "the capacity 
to experience anxiety without having to 
act to discharge it." They went on to say, 
"this can be judged in many ways; by 
reactions to discussions of painful prob- 
lems, by observations of levels of overt 
anxiety, its height, duration, and the pres- 
sure to rapid and impulsive discharge; 
nature of behavioral, internal psychologic, 
and of somatic patterns of discharge." 
This definition, which accurately reflects 
our current clinical usage, leads to certain 
theoretical and practical difficulties. It 
seems to us to limit unduly the application 
of the construct anxiety tolerance. 

The operative word in restricting its 
range of application is "act." Act can be 
variously defined. It seems to us, however, 
that the connotations of the term in this 
definition involve only a certain kind of 
"acting." Consider, for example, a well- 
compensated, tightly organized obsessive- 
compulsive neurotic who successfully 
maintains himself without extreme or dis- 
abling conscious anxiety through con- 
tinual yielding to internal demands that 
he perform compulsive acts of a mild 
sort. Here is an individual who acts 
in order to free himself from anxiety 
or reduce the quantity of anxiety he 
experiences. Yet, to describe this man 
as lacking in anxiety tolerance would 
not be consistent with the clinical prob- 
ability that were he to be deprived 
of the opportunity to carry through his 
compulsive rituals, he would probably 
experience a significant increase in the 
amount and intensity of manifest anxiety 
without any increased tendency to "act." 
Under such circumstances we would be 
dealing with a partially decompensated 
obsessive-compulsive neurotic experienc- 
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ing more manifest anxiety, who would 
probably tend to become more ruminative, 
circumstantial, obsessional, and indecisive. 
In this clinically plausible hypothetical 
case the intensity of experienced anxiety 
would have increased while the indivi- 
dual's tendency to act to diminish the 
anxiety would have decreased. Does this 
situation reflect a rise in anxiety toler- 
ance? 

If the same individual continues to 
decompensate, his characterological de- 
fense patterns will be used more vigor- 
ously, more frequently, more arbitrarily, 
and with diminishing effectiveness in re- 
ducing the impact and intensity of anxie- 
ty. His thinking may display more and 
more primary process characteristics and, 
in short, he may become near psychotic 
or psychotic. While the course of the de- 
compensation and its results in symp- 
tomatology and behavior are not wholly 
predictable, one possible course is towards 
increased ideational activity which may be 
more and more autistic, perhaps paranoid 
or perhaps simply overideational. No 
significant increase in the tendency to 
dispel anxiety via action need occur be- 
cause the preferred obsessive-compulsive 
characterological modes of defense and 
control rely heavily upon binding anxiety 
in ideational activity. Even with increas- 
ingly ineffective ideational binding of anx- 
iety, the characterological tendency to in- 
hibit motor discharge may remain more 
or less operative. There is no intent here 
to disregard the clinical reality that the 
tendency to act to reduce anxiety is 
heightened in some cases. The course of 
decompensation obviously differs among 
individuals. It is sufficient to make our 
point tfaat_jhere are iiqgrvidualsjsdx) de- 
compensatF without anincreasing^ ten- 
dency to discharge anxiety through ac- 
tion/Are we to characterize anxiety toler- 
ance as having increased in the course of 
a decompensation to a more regressed 
level of thinking and behaving? 



This line of thought made it increasing- 
ly clear to us that the kind of action re- 
ferred to in the project's definition of 
anxiety tolerance is the kind loosely char- 
acterized as arising from an alloplastic 
orientation, a disposition to discharge 
anxiety-provoking tension, or tendency to 
"act out." (This latter is perhaps the most 
loosely used technical term in the clinical 
vocabulary.) It makes perfectly good 
sense and is in clear accord with our 
everyday clinical usage to characterize an 
individual who tends to prevent himself 
from experiencing anxiety by running 
away, drinking, avoiding anxiety-arousing 
situations, and so on, as one in whom 
anxiety tolerance is low. This is the lim- 
ited area of application of the concept of 
anxiety tolerance as heretofore defined. 

One of the undesirable concomitants 
of limiting the use of the term in this way 
is that it vioktes one's feeling that or- 
ganizing concepts should apply to the 
whole range of phenomena involved. The 
concept of physiological tolerance, the 
tolerance of the organism for a certain 
drug, let us say, is one which does apply 
to a whole range of phenomena and in- 
dividuals. 

In doing an experiment on the toler- 
ance of rats for a given drug, one might 
observe that rats of a certain strain, or 
rats reared under certain conditions, or rats 
of a certain color, differ in their tolerance 
for the drug. One might even find that 
intolerance for the drug is manifest in 
differing symptoms depending on the size 
or color or physical condition of the 
laboratory animal. Even so, the concept of 
physiological tolerance applies equally to 
all of the laboratory animals. 

How does the concept anxiety toler- 
ance apply to autoplastically oriented in- 
dividuals, for example, particularly those 
who are psychotic? 

Let us examine, before we proceed fur- 
ther, the meaning of alloplasticity and its 
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converse, autoplasticity. The variable allo- 
plasticity was defined for our project by 
Wallerstein and Robbins ( 1956) as, "The 
nature and extent of the expression of the 
illness on the environment and the dele- 
terious consequences to the environment." 
Our use of the concept is somewhat dif- 
ferent since this definition makes it a con- 
cept which has only partial reference to 
intrapsychic processes. If one has to evalu- 
ate to what extent deleterious conse- 
quences of the patient's actions exist, one 
must investigate the environment rather 
than the patient. Psychological tests do 
not yield this information. We need a con- 
cept, however, which captures the under- 
standing of intrapsychic processes implicit 
in the thinking of so many clinicians 
when they try to distinguish between in- 
dividuals who will "act out" (speaking 
loosely) and those who will not. We have, 
without redefining the term in any ex- 
plicit way, used the category alloplasticity 
to describe the extent of the individual's 
tendency to discharge anxiety, or to avoid 
it, rather than to attempt to bind it or 
to suffer it. 

We, of course, realize that one can't 
accurately characterize people in this re- 
spect as either-or. The most alloplastic in- 
dividual utilizes some autoplastic methods 
of dealing with anxiety and the reverse is 
true. An underlying continuum is implied 
and we are aware of the arbitrariness in 
calling an individual auto- or alloplastic- 
ally oriented. We feel, however, that this 
may not be wholly inappropriate in a 
preliminary exploration of the kind we are 
undertaking here. Further, since we intend 
to describe shifts towards or away from 
alloplasticity it should be clear that we 
will be describing directions of change. 

When we describe an individual as 
having shifted in an alloplastic direction, 
this does not imply that he is "an allo- 
plastic individual." He may remain pre- 
dominantly autoplastic in his way of de- 
fending himself against anxiety and yet he 



may have moved in the direction of allo- 
plasticity. The same applies to the "auto- 
plastic individual." The individual who is 
described as moving in the direction of 
increasing autoplasticity may not have 
moved far enough, so to speak, to be con- 
sidered autoplastic and yet there may have 
been a development of autoplastic devices 
for dealing with anxiety. 2 

By alloplastic we mean the tendency to 
attempt to dispel experienced anxiety or 
to ward off threatening anxiety by acting 
upon and changing the environment. The 
autoplastically oriented individual's defen- 
sive efforts, in contrast, are directed toward 
altering himself, or some aspect of him- 
self, to dispel or bind anxiety. The indi- 
vidual who repeatedly reacts to threatened 
eruptions of anxiety by getting drunk, 
changing jobs, driving 90 miles an hour, 
or getting into fights is alloplastkally 
oriented. The individual, on the other 
hand, who tends to react to intense anxiety 
by ruminating, developing phobias, in- 
trusive thoughts, or delusions, is reacting 
autoplastically. The individual who finds 
himself responding to more or less mild 
anxiety with a fantasy or daydream, on the 
autoplastic side, may be contrasted with 
the individual who responds to mild 
anxiety by taking an extra before-dinner 
cocktail or impulsively setting up a late 
afternoon nine holes of golf. 

There are, of course, difficulties in as- 
sessing anxiety tolerance. We do not mean 
simply the lack of reliability or validity 
of the instruments one has available but, 
rather, the difficulties in principle of asses- 
sing anxiety tolerance. For example, it is 
easy to assess if one is confronted with an 

2 Since presenting this in Chapel Hill it has 
become clear to us (through examination of 
cases in which independent judges disagreed 
on the direction of change after psychotherapy) 
that allo- and autoplasticity are not simply 
opposite poles of the same continuum. It is 
possible, we have seen, for patients to increase 
in both auto- and alloplasticity. Further con- 
ceptual refinement is thus clearly in order. 
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individual who is quite anxious yet simply 
suffers the anxiety. By definition his anxie- 
ty tolerance is high. What of the indi- 
vidual, however, who is to a great extent 
anxiety free? What, in other words, is the 
role of experienced anxiety itself in as- 
sessing anxiety tolerance? 

How is one to assess anxiety tolerance 
if only mild anxiety is manifest? Anxiety 
tolerance, it seems to us, is a concept 
analogous to, say, potential energy in 
physics. If one investigates a boulder pre- 
cariously balanced on the lip of a precipice 
he need not wait until the boulder plunges 
over to calculate the forces involved. 
Measuring various aspects of the physical 
structure of this situation, the mass of the 
boulder, the distance it will drop, etc., and 
performing a few computations will yield 
the answer. In theory, we should be able 
to assess anxiety tolerance, or more ac- 
curately put, potential anxiety tolerance, 
without waiting for the boulder to drop 
or the patient to become anxious to the 
limits of his tolerance for anxiety. To do 
so requires investigation and assessment 
of the structural factors in the situation 
(the patient's defenses and controls) and 
the dynamic-economic aspects of the situa- 
tion ( the forces involved ) . In the boulder- 
precipice situation the dynamic aspects are 
well known and are encompassed by the 
formula for the acceleration of a free- 
falling body. We have no such constant 
as gravity to work with and here, of 
course, the analogy breaks down since we 
have no reason to assume the forces we are 
dealing with are constant from individual 
to individual. 

Looking through the relevant parts of 
our test-retest reports, we noted the fre- 
quent occurrence of such statements as, 
"she is less frightened of losing control 
over her impulses"; "the patient is no 
longer so threatened by the possibility of 
being overwhelmed by his impulses or by 
anxiety"; "the patient's marked decrease in 
vulnerability to primitive poorly modu- 



lated infantile outbursts"; "extremely vul~ 
nerable to waves of disorganizing anxiety 
and panic." In 12 of 18 reports some phrase 
appeared, concerning either the picture 
before or after therapy, referring to the 
possibility of "loss of control," "disorgani- 
zation," or being "overwhelmed." In many 
reports the word anxiety was invariably 
accompanied by such modifiers as "disor- 
ganizing," "of panic proportions," or some 
phrase suggesting not only that the anxie- 
ty alluded to was especially intense but 
that in fact it was likely to be over- 
whelming. 

Turning to the psychoanalytic litera- 
ture, we found that Rosenberg (1949) 
pointed out that from its earliest period, 
psychoanalytic theory of the nature of 
anxiety has approached the subject from 
two points of view. On the one hand, the 
relationship of anxiety to instinctual frus- 
trations has been stressed. Although Freud 
(1927) made considerable modifications 
in his conception and orientation in this 
respect, he continued to stress the close 
relationship of anxiety to quantities of 
frustrated instinctual tension. In Inhibi- 
tions, Symptoms and Anxiety, he distin- 
guished between two types of anxiety. He 
recognized and explicitly stated the value 
of anxiety as a response to an internal 
danger situation. He did not, however, 
abandon his earlier emphasis on accumu- 
lations of excitation which cannot be dis- 
charged. He thus gave the name primary 
anxiety or the traumatic factor to the con- 
dition directly brought about by helpless- 
ness in the face of overwhelming excita- 
tion. Secondary anxiety, in contrast, was 
defined as an ego reaction which becomes 
manifest as a signal that a danger situa- 
tion may arise. Jones (1957, p. 256) com- 
ments: 

In the traumatic situation all the protective 
barriers are overrun, and a panicky helplessness 
results, a response which Freud called inevit- 
able but inexpedient. Most clinical instances 
of anxiety, however, may be called expedient, 
because they are essentially signals of approach- 
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ing danger which for the most part may then 
be avoided in various ways. Among these is 
the action of repression itself, which Freud now 
regarded as being set in action by the anxiety 
instead of, as he had previously thought, being 
the cause of the anxiety 

Anna Freud (1937) as well, in The 
Ego and the Mechanism of Defense in- 
cluded in a list of "motives" for the de- 
fense against instincts, "instinctual anxiety 
or dread of the strength of instincts." She 
quoted Robert Waelder who described 
"the danger that the ego's whole organiza- 
tion may be destroyed or submerged/' 
Miss Freud (1937, Ch. V) stated, 
. . . the only pathological states which fail to 
react favorably to analysis are those based on 
the defense promoted by the patient's dread of 
the strength of his instincts. In such a case 
there is a danger that we may annul the de- 
fensive measures of the ego without being able 
immediately to come to its assistance. In analy- 
sis we always reassure the patient who is afraid 
of admitting his id impulses into consciousness 
by telling him that, once they are conscious 
they are less dangerous and more amenable to 
control than when unconscious. The only situ- 
ation in which this promise may prove illusory 
is that in which the defense has been under- 
taken because the patient dreads the strength 
of his instincts. 

Whether, in fact, there exist two quali- 
tatively different variants of anxiety or 
whether the distinction between "pri- 
mary" and "secondary" anxiety is simply a 
quantitative one, it is clear that the impli- 
cations of experienced anxiety differ from 
patient to patient. That is, anxiety of a 
certain intensity in individuals with cer- 
tain defensive ego structures is disorgan- 
izing (or "primary," if you like). Other 
individuals are able to utilize the anxiety 
as a signal of danger to the ego. 

The capacity to experience signal anx- 
iety, in other words, varies among indi- 
viduals. It is just this capacity, we propose, 
that constitutes anxiety tolerance. To de- 
fine anxiety tolerance as the capacity to 
experience signal (or "secondary") anx- 
iety? simple mougn it may souacps to 

3 Our colleague, Gerald A. Ehrenreich, 
points out that this definition includes im- 



make the concept applicable to all indi- 
viduds," not "just" those" who" Respond allo- 
plastically to the thfeaFened "arousal" of 
anxiety. The autopiastkally oriented indi- 
vidual for whom anxiety has become dis- 
organizing (or primary, if you will) with- 
out an increased tendency to motor ac- 
tivity, has just as little capacity for the 
experience of signal anxiety as his allo- 
plastically oriented, impulse-ridden coun- 
terpart. 

This definition, we feel, represents ex- 
plicitly something that most clinicians 
recognize implicitly: that the meaning 
and consequences of experienced anxiety 
differ depending on the individual's ego 
structure (and thus the course of his ego 
development) (Greenacre, 1941). 

Let us now apply the redefined concept 
anxiety tolerance to our group of subjects 
attempting to describe the patterns of 
change noted from pre- to posttherapy 
psychological tests. (Again, note that there 
is no intention to imply arbitrary dicho- 
tomies. We are concerned here more with 
direction of change in anxiety tolerance 
than with the magnitude). 

Our studies of change in anxiety toler- 
ance in 18 patients upon whom we have 
currently completed pre- and posttherapy 
psychological test studies show us, of 
course, that the pattern of change varies 
from patient to patient and that the differ- 
ences in individual patterns of change far 
outweigh their similarities. When we say, 
for example, that there has been an in- 
crease in anxiety tolerance and an increas- 
ing reliance upon autoplastic ego activi- 
ties, we realize that this statement, applied 
to a group of patients in our study, is, of 
course, a highly abstract, and perhaps 
overly general one. Each individual of 

plicitly, the ego function of discriminating the 
signal as such; that is, not solely the tolerance 
for the experience of anxiety but the ability, 
in addition, to recognize it as a signal. There- 
fore, an increase in anxiety tolerance implies 
improved ego functioning. 
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whom this statement is partially true re- 
veals under intensive study his unique pat- 
tern of change, generally involving com- 
plex and interrelated alterations in vir- 
tually all of the intrapsychic variables con- 
sidered in the project. Defensive realign- 
ments occur, energy redistributions are 
seen, impulse-defense configurations have 
undergone reorganization. The precise 
alteration of defenses (i.e., the increasing 
or decreasing utilization of a specific de- 
fense, along with changes in the rigidity 
of such a defense, or the pervasiveness of 
its use, or its brittleness) all vary widely 
from individual to individual. Neverthe- 
less, certain commonalities appear which 
seem to form the basis for four distin- 
guishable patterns of change. 4 

/; Increased Anxiety Tolerance with In- 
creased Prominence of Atttoplasticity 
We note first a group of five patients 
of whom it may generally be said that 
anxiety tolerance has increased along with 
an increasing tendency toward the utiliza- 
tion of autoplastic ego operations. These 
five patients seemed to share some com- 

4 In Chapel Hill the conferees very cogently 
questioned the lack of evidence of reliability. 
Subsequently, independent judgments by a 
psychiatrist, based on the same test reports as 
were our consensus judgments, proved to be in 
agreement with us in 78% of the anxiety toler- 
ance and 67% of the allo-autoplasticity in- 
stances. 

To make independent judgments based di- 
rectly on test data would necessitate an experi- 
enced psychologist going over, in detail, the 
entire pre- and posttherapy test protocols in 
order to arrive at some more or less explicitly 
integrated picture of the personality structure 
and its changes following therapy. Then, and 
only then, would in-context, meaningful judg- 
ments of changes in anxiety tolerance be made. 
Hundreds of man-hours might be involved in 
this task. This forces one, as do many questions 
raised in Chapel Hill, to confront the choice of 
where first to invest limited energies and re- 
sources. Shall one start by seeking more certain 
knowledge or broader conceptual clarity? Con- 
cepts defined in ways to achieve maximal re- 
liability are likely, at this stage of our knowl- 
edge, to possess low construct validity. 



mon characteristics. In general, there 
seemed to be a simultaneous strengthen- 
ing of defensive ego operations, and an 
increasing flexibility characteristic of 
them. Impulse controls tended to be more 
stable, less erratic. Patients in this group 
were less given to affect storms, which 
prior to treatment had often carried them 
into impulsive, irrational behavior. Fol- 
lowing treatment their use of avoidance 
was less prominent, and indeed in several 
of the cases heightened conscious anxiety 
was seen. Probably the most striking com- 
mon feature in the changed pattern of 
functioning characteristic of this group 
was an increased use of ideational activity 
to bind anxiety. Insight, reflectiveness, 
self-awareness all tended to increase. 
Longer, more productive Rorschachs, less 
banal and cliche-ridden TAT stories, and 
Word Association protocols pointing in 
the direction of at least greater awareness 
of (if not complete resolution of) con- 
flicts tended to be the rule. Affects and 
anxiety became less diffuse and free-float- 
ing and were more often seen in an appro- 
priate ideational context. This "focalized" 
rather than diffuse quality to affect experi- 
ence also tended to characterize the allo- 
plasticity which, of course, remained an 
important part of the functioning of such 
patients despite their movement toward 
increasing autoplasticity. The alloplasticity 
was, following treatment, often more re- 
stricted and controlled. 

II: Increased Anxiety Tolerance with In- 
creased Prominence of Alloplasticity 
Six of the 18 patients comprise another 
group. While showing increased anxiety 
tolerance (as did patients in the group 
described above), this is, in the main, a 
group of patients who prior to the start 
of treatment showed a variety of primarily 
autoplastic pathological manifestations. 
This group was characterized at the time 
of initial study by the extreme prominence 
of ideational activity. In some this took 
the form of rigid obsessional intellectual- 
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izing (accompanied by isolation and re- 
action formation), all of which defensive 
activity tended to preclude, to a great ex- 
tent, the experience of spontaneous affect. 
One of the group was characterized by the 
presence of severe depression and phobic 
ideation. Two of the group, at the time of 
their initial testing, revealed throughout 
their test protocols gross confabulations, 
peculiarities of thought and language, and 
reality distortions indicative of ideational 
pathology of a psychotic degree. Again, 
we found a number of common elements 
which seemed to be associated with in- 
creased anxiety tolerance. Principally, 
there was greater ideational control; these 
patients were more able to curb the loose, 
overexpansive thinking that had been so 
characteristic of them. At the same time, 
these individuals showed an increased 
tolerance for affect. Each of the reports 
alludes to their being "less afraid of the 
strength of their affects." Constriction of 
ideational activity (in the sense of curb- 
ing its more overexpansive deviant mani- 
festations) was accompanied by a tend- 
ency toward freer affect experience and 
impulse expression. It is a striking clinical 
characteristic of this group that all but 
one, shortly after the termination of treat- 
ment, made major changes in his life 
situation: three married, one began career 
training, another assumed a significantly 
and appropriately important role in his 
family's business. 

777; Decreased Anxiety Tolerance tuith In- 
creased Prominence of Autoplasticity 
Next let us look at a group of five 
patients in whom we saw, following treat- 
ment, a decrease in anxiety tolerance and 
increasing reliance on what proved to be 
inadequate autoplastic ego devices. These 
are people who to begin with had rela- 
tively rigid defenses against self -scrutiny. 
They most often presented meager con- 
stricted and guarded test protocols. It is 
striking that the initial assessments of 
each of them mentioned, in one way or 



another, their chronically being threatened 
with the possibility of extreme and not 
readily reversible regression. For this 
group, change as seen on the tests gen- 
erally took the form of an increase in 
ideational fluidity, the appearance of arbi- 
trary misperceptions of reality; in short, 
decompensation in the direction of 
thought disorder. 

The role of ideation for these patients 
deserves special consideration. In the 
Group I patients we described, those in 
whom an increase in anxiety tolerance was 
accompanied by greater prominence of 
autoplastic intrapsychic events, ideation 
was relatively successful in binding 
anxiety. In the Group III patients, on the 
other hand, ideation did not successfully 
serve this purpose. Instead, intensified 
ideational activity was not useful to the 
patient as a means of either binding anx- 
iety or delaying direct motor impulse dis- 
charge. Indeed, fantasy, rather than serving 
as a check to impetuous action, more often 
served as a spur to it. Anxiety was strik- 
ingly disorganizing of the formal thought 
functioning in this group. In the test pro- 
tocols of these patients were seen numer- 
ous instances of autistic and dereistic 
thinking, ranging from fleeting borderline 
psychotic manifestations to fixed somatic 
delusions. At follow-up we learned that 
this group of patients fared poorly. Three 
are dead, two by suicide, the third by 
neglect of a serious physical illness. One 
of the group, hospitalized at the time of 
follow-up study, was in a severely re- 
gressed state, with a number of fixed 
somatic delusions and auditory hallucina- 
tions. 

IV: Decreased Anxiety Tolerance with In- 
creased Prominence of Alloplasticity 
Our fourth group consists of those pa- 
tients who at termination showed a de- 
crease in anxiety tolerance coupled with 
greater utilization of alloplastic tension- 
relieving devices. This group consists of 
two patients whose psychological tests, for 
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all of their impressive differences, show a 
number of interesting similarities. Prin- 
cipally, these two patients are character- 
ized by an increased, almost extreme con- 
striction of ideation. The test reports de- 
scribed their increased reliance on avoid- 
ance and denial Heightened negativism 
and increased guardedness characterize 
both of them. Along with increased 
rigidity of defensive functioning, in both 
patients, we saw greater emphasis on allo- 
plastic behaviors. Both had prematurely 
terminated psychotherapy and both psy- 
chotherapies were characterized by faulty 
communication between patient and 
therapist. In one case psychotherapy was 
characterized by lengthy silences which 
could not be successfully dealt with. In 
the other case, psychotherapy was char- 
acterized by the withholding of informa- 
tion on the part of the patient, particularly 
in regard to homosexual activity. There 
have been thus far in the project three pa- 
tients, all of whom have severe disturb- 
ances in impulse control, who precipitous- 
ly interrupted treatment and refused to 
participate in a psychological test study. 
Conceivably these patients might also 
belong in this group. 

It should be pointed out that in each of 
these four groups the striking commonali- 
ties would not be visible simply from 
diagnostic labels or degree of improve- 
ment ratings. Nor could such groupings 
be arrived at on the basis of presence or 
absence of manifest anxiety. Each of the 
four categories contains patients seen at 
termination as less anxious and those seen 
as more anxious. 

Let us at this point attempt to review 
the logic of this presentation. We have 
sought to understand as much as we can 
about changes in our patients viewing 
them from one restricted standpoint only. 
We have attempted something analagous 
to a histological approach looking at one 
type of tissue in an organism which con- 
tains many varieties of cell structure and 



tissue. Placing each patient on a micro- 
scope slide, as it were, and applying the 
same stain to each, what structures become 
visible? We found, however, that our 
stain was not properly constituted since it 
"didn't take" on some of the patients. We 
changed it. We redefined the concept 
anxiety tolerance to be able to apply it to 
each patient. Without taking a position 
on the question of whether there are two 
variants of anxiety, it became clear in our 
review of the literature that some people 
have thought so. We found that for some 
patients anxiety reflects the danger of the 
ego's being overwhelmed by instinctual 
pressures. For others, anxiety rather serves 
as a signal, not that the internal psycho- 
logical structure of the ego is breaking 
down, but that further ego activity is re- 
quired to meet internal or external danger. 
To restrict the use of the term anxiety 
tolerance to the capacity to experience 
signal anxiety makes it possible to apply 
the concept to all our patients. We classi- 
fied patients as to whether change has 
been in the direction of increased or de- 
creased anxiety tolerance following psy- 
chotherapy. We considered the nature of 
shifts in defensive activity; whether de- 
fensive activity moved more in the direc- 
tion of the tendency to bind anxiety auto- 
plastically, on the one hand, or the tend- 
ency to dispel it, or avoid it, alloplastically, 
on the other hand. Applying these two 
classification criteria enabled us to discern 
meaningful commonalities within groups 
of patients. 

The issue of evaluating change in terms 
of success or failure is relevant here. All 
those patients we saw as having changed 
in the direction of diminished anxiety 
tolerance probably can be thought of as 
"unimproved" or "less improved." (We 
do not have available to us an independent 
criterion of change, at this point, although 
some of the criteria Luborsky touches 
upon in his paper can, at a later point, be 
applied to our groupings.) Not all those 
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patients, however, whose anxiety tolerance 
increased can be described as therapeutic 
successes. This is reassuring to us in that 
it would suggest we are not simply differ- 
entiating "the therapeutic good guys" 
from "the bad guys." Considering patients 
from the single point of view of anxiety 
tolerance, as we have, may have brought 
into focus one important component of 
therapeutic failure. 

Luborsky (1961) suggests, in his con- 
tribution to this conference, the hypothe- 
sis that, "For the patients who start treat- 
ment with at least a moderately high ca- 
pacity for autonomous functioning, etc., 
the higher the level of anxiety the greater 
the change that is likely." This hypothesis 
is based on his tentative finding that the 
correlation between amount of change (as 
reflected by the Health-Sickness Rating) 
and initial (pretherapy) anxiety level is 
a function of initial (pretherapy) Health- 
Sickness Rating. May we suggest that this 
finding (and the consequent hypothesis 
arising from it) reflects precisely our 
point, that the significance of anxiety 
varies among individuals; that there is 
pragmatic value in identifying signal 
anxiety and the individual's capacity (if 
this is the proper term) for experiencing 
it. 

We hypothesize that to account for and 
understand changes in patients who have 
undergone psychotherapy, it is obligatory 
to consider the extent to which they have 
developed, increased or decreased, the ca- 
pacity to experience anxiety as a signal 
that further ego activity is required. This 
implies that the presence or absence of 
anxiety after treatment is not, in itself, 
sufficient to understand or evaluate the 
change that has occurred. It is a datum 
that can only be fully understood in rela- 
tion to changes in the individual's ways 
of dealing with anxiety. And it further 
implies, to us, that dose clinical scrutiny 
of limited aspects of intrapsychic processes 
and functioning can potentially lead to 



conceptual schemata which make it pos- 
sible to understand more fully, disparate 
groups of patients. Perhaps now we can 
better understand what is expressed by 
many psychotherapists when they con- 
sider severe impulse-ridden characters to 
be just as recalcitrant to psychotherapeutic 
treatment as regressed psychotics. This 
truism seems to us clarified when one 
isolates the relevant intrapsychic variables. 
We suggest that one relevant variable is 
the capacity for the experience of signal 
anxiety or, if you will, anxiety tolerance. 
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What Kind of a Situation is the 
Psychotherapy Situation? 

In considering any social situation, 
whether it be from the viewpoint of a 
participant or from the viewpoint of an 
observer, an explicit or implicit decision 
is involved as to the character of that 
situation. Psychoanalysts, for example, 
tend to view the psychotherapy situation 
as one which facilitates the recall and ex- 
ploration of unconscious memories and 
strivings; or one which deals with the 
recall and/or re-experiencing of signifi- 
cant events in the patient's infancy or 
childhood. Doing research within this 
framework requires the development of 
concepts and categories by which uncon- 
scious ideas and strivings (dependent, ag- 
gressive, etc) might be identified and 
described, and the creation of categories 
by which the manifest content of behavior 
during treatment might be characterized 
(transference, defense, resistance). 

As a result of a previous interest in the 
present group of researchers at Columbia 
University and because of the limited 
number of approaches to the treatment 
situation derived from the social sciences, 
it was decided to view the psychotherapy 
situation in other ways: 

1. As an interaction situation, a situa- 
tion where two people are engaged in an 
interdependent and reciprocal interaction 
process. Just as has been observed in other 
types of interaction systems, it was ex- 
pected that form and content and com- 

1 Support for the research reported in this 
paper under National Institute of Mental 
Health Research Grants M 1076 and M 2882 
is gratefully acknowledged. 

This paper is adapted from Lennard and 
Bernstein (19-60). 



munication in psychotherapy would un- 
dergo systematic changes over time. It 
was further believed that it would be pos- 
sible, just as it had been possible for other 
social systems, to identify self-regulating 
processes in the therapy system. 

2. In agreement with other investiga- 
tors, the psychotherapy situation might be 
considered as a learning situation. But in- 
stead of merely considering the learning 
of particular contents about oneself and 
others that may occur during treatment, 
special attention was devoted toward the 
analysis of the learning of the dimensions 
of social roles. Psychotherapy was con- 
sidered a situation wherein as a result of 
being "socialized" into the therapist- 
patient system, the patient could learn to 
identify the relevant dimensions of other 
role systems in which he participates 
( deutero-learning) . 

3. We considered psychotherapy to be 
an information exchange and information 
processing situation. We were particularly 
interested in pinpointing the differential 
consequences in patients* verbal behavior 
of varying degrees of specificity in the 
structure of the therapists' informational 
behavior. 

Adopting one or all of these approaches 
when studying the psychotherapeutic in- 
teraction requires the development of par- 
ticular sets of categories for analysis of 
therapeutic process, and aff ects how much 
and in what sequence therapeutic data 
need to be processed. For example, in 
order to analyze interaction processes 
through time, it is necessary to classify 
sequences of communication continuously 
for a substantial number of sessions. Of 
course, were an investigator concerned 
only with the occurrence of a particular 
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phenomenon in psychotherapy, he might 
find it possible to restrict his analysis to a 
less extensive amount of the behavior oc- 
curring between the patient and the 
therapist. 

In order to keep within its allotted size, 
this paper does not review those aspects 
of the research which were relevant to the 
conception of psychotherapy as an infor- 
mational exchange and information proc- 
essing situation. In covering the work 
oriented around the study of therapy as an 
interaction system and as a role-learning 
situation, I will try to present the con- 
ceptual approach and definition of vari- 
ables fairly completely and be more selec- 
tive in presentation of findings. 

CONCEPTS RELEVANT TO VIEWING 

PSYCHOTHERAPY AS AN INTERACTION 

AND A ROLE-LEARNING SITUATION 

While it is not generally denied that 
the psychotherapy interaction constitutes 
a genuine interactional relationship (by 
definition, two or more persons in physical 
proximity, aware of each other, and ex- 
changing messages constitute an inter- 
action system), the implications of the 
conception have not been pursued system- 
atically in the study of therapy. 

In the study of interaction as a system, 
a number of concepts have proven useful 
and we, therefore, decided to introduce 
them into the study of therapeutic inter- 
action. These concepts were: 

Interdependence 

The concept of interdependence be- 
tween variables rather than a unilateral 
relationship between variables is central 
to the concept of system. Interdependence, 
in the words of Parsons and Shils ( 1951 ) , 
"consists in the existence of determinate 
relationships among the parts or variables 
as contrasted with randomness of vari- 
ability. In other words, interdependence 
is order in the relationship among the 
components which enter into a system." 



Equilibrium 

The order in the interrelationship 
among the units of the system possesses a 
"tendency to self-maintenance, which is 
very generally expressed in the concept of 
equilibrium. It need not, however, be a 
static self-maintenance or stable equilib- 
rium. It may be an ordered process of 
change a process following a determi- 
nate pattern rather than random varia- 
bility relative to the starting point" (Par- 
sons & Shils, 1951). The sociological 
restatement of this conception of equilib- 
rium in connection with systems of action 
would be that "there appears to be some- 
thing underlying the observed overt be- 
havior, which has a continuity and per- 
sistence through time. It seems to act like 
an accounting system which takes account 
of deficits and surpluses that appear with- 
in given small time spans in such a way 
as to tend toward restoration of certain 
balance in quality and distribution of ac- 
tion among members over long time 
spans" (Bales & Slater, 1954). 

Differentiation 

Implicit to a system is a span of time. 
By its very nature a system consists of an 
interaction, and this means that a sequen- 
tial process of action and reaction has to 
take place before we are able to describe 
any state of the system or any change of 
state. Differentiation is defined as a tem- 
poral or phase phenomenon in which the 
behavior of the participants is seen to 
differ systematically over time. The con- 
cept of temporal differentiation implies, 
for instance, that the distribution of com- 
municative acts of individuals encounter- 
ing each other for the first time will differ 
from the distribution of their communica- 
tive acts occurring on the tenth encounter. 

Socialization 

In order for a therapeutic system to 
begin to function, it is first necessary for 
the patient to be inducted into the "pa- 
tient role," that is, to acquire the set of 
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role expectations which are reciprocal to 
the therapist. The learning of a social role 
is referred to by sociologists as: "socializa- 
tion." Socialization, as defined by Merton 
et al. (1957), "designates the process by 
which people selectively acquire the values 
and attitudes, the interests, skills and 
knowledge in short, the culture current 
in the groups in which they are, or seek 
to become a member. Socialization takes 
place primarily through social interaction 
with people who are significant for the 
individuals." In our view, a therapist's 
task as a socializer is analogous to a parent 
socializing a child into the family or of a 
teacher socializing a student into the 
school situation. Socialization of the pa- 
tient into the patient role is one of the 
crucial or necessary tasks in the construc- 
tion and maintenance of therapeutic 
systems. 

Deutero-Learnmg 

This concept, developed by Gregory 
Bateson, has also been described as "learn- 
ing how to learn," and refers to the fact 
that in any given learning situation, one 
learns not only what one is supposed to 
learn, but also something about the 
process of learning itself. 

Perhaps two brief illustrations will 
suffice here. In learning a foreign lan- 
guage, one not only learns the particular 
language but also about the process of 
learning a language. Each successive lan- 
guage is more easily mastered. Learning 
one card game prepares one for the learn- 
ing of the next because one has not only 
learned the rules of the particular game, 
but also that card games involve among 
other things the distribution of cards 
among players, symbolic meaning of ac- 
tion, patterns of plays, different values of 
cards, the use of strategy and deception, 
and so forth. 

Satisfaction 

The concept of satisfaction permits one 
to assess the reaction of participants of 



interaction systems. The satisfaction that 
a participant derives from communication 
is closely related to his expectations (in 
the sense of wishes). If the communica- 
tion fulfills these expectations, he will ex- 
perience some degree of satisfaction. If 
the communication does not fulfill his ex- 
pectations, and he is thereby disappointed, 
he will experience dissatisfaction. 

Methodology 

The problems inherent in an analysis 
of communication during psychotherapy 
are complex. Before a quantitative and 
systematic attack on these problems could 
be undertaken, it was first necessary to 
collect the kind of data which would make 
such an effort possible. We thus found 
ourselves faced with the task of assem- 
bling a reasonably large body of verbatim 
psychotherapy data that would constitute 
a library of facts from which we could 
draw material to test our hypotheses. 

The number of cases that could be re- 
corded and transcribed for the purpose of 
our study was limited by considerations of 
time and money. Ultimately, however, it 
became possible to obtain verbatim re- 
cordings of eight therapies over a period 
of almost a year each While a sample of 
eight does not seem large, such a sample 
consists of well over 500 hours of treat- 
ment and contains tens of thousands of 
scorable communication units. 

It would probably be fair to say that we 
were not engaged primarily in a "fact 
finding" research but rather in a research 
designed to develop and test a methodol- 
ogy and to uncover hypotheses. Most of 
the findings that we report are not sample 
statistics to be generalized but parameters 
of our own group of eight therapist- 
patient pairs. When, for example, we re- 
port that a given variable decreases over 
time, we are not generalizing, but describ- 
ing what actually happened to that vari- 
able within the group of cases we studied. 

The study, however, is multidimen- 
sional and multilevel, and the confidence 
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that one can place in a generalization from 
the findings will vary with the dimension 
or level. Moreover, the number of cases 
also varies from level to level and cate- 
gory to category. In setting confidence 
limits, it should be borne in mind that 
different total numbers are involved in 
the "sample." There were only 4 thera- 
pists, but there were 8 dyads, 500 sessions 
(over 120 of these were coded), 5,985 
exchanges, and 41,513 verbal propositions 
coded along multiple dimensions. 

Four psychotherapists agreed to co- 
operate with the project for the purpose 
of data collection. Three of the four thera- 
pists have been or are currently affiliated 
with a psychoanalytic institute recognized 
by the American Psychoanalytic Associa- 
tion. The fourth therapist is a graduate 
of a program in Clinical Psychology ap- 
proved by the American Psychological 
Association and has been in practice for 
more than ten years. 

The patients in our project were re- 
ferred from psychotherapy clinics in the 
New York City area. All were informed 
of the research nature of the project and 
agreed in advance of their first contact 
with the therapist to permit the recording 
of their hours and to fill out questionnaires 
from time to time. 

In addition to the verbatim recordings 
of the therapy sessions, patients and thera- 
pists were interviewed prior to therapy 
and were given questionnaires to fill out 
at intervals during treatment. The inter- 
views and the questionnaires sought in- 
formation on role expectations of thera- 
pists and patients; how therapists and pa- 
tients perceived and evaluated the inter- 
action that had occurred during particular 
hours (thus similarities and dissimilari- 
ties could be compared), and how thera- 
pists and patients viewed their interaction 
in retrospect. 

Units of Quantity 

Our task was to find methods for re- 
cording and analyzing the operations be- 



tween the patient and the therapist and 
to find out which of these units of be- 
havior were amenable to management. 
We could not reasonably expect any single 
method of examination to give us more 
than a limited amount of information, 
and so we were willing to use as many 
methods as were required for the assign- 
ment. 

1. Proposition. A proposition for the 
purpose of this study was defined as a 
verbalization containing a subject and a 
predicate either expressed or implied. It 
is the verbal expression of a single idea. 
Essentially the same definitions and in- 
structions used by Bales, Dollard, Murray, 
and others were used by our coders to 
separate the transcripts into prepositional 
units. 

In order to determine the reliability of 
unitization, the same therapy session was 
coded independently by two different 
coders. A total of 332 propositions was 
scored for the session by Coder A and 334 
propositions for the session by Coder B, 
a difference of less than one percent. 

2. Statement. A statement is an unin- 
terrupted sequence of propositions from 
either the therapist or patient. While 
therapist statements rarely consist of more 
than three propositions, patient statements 
sometimes contain more than 100 propo- 
sitions. 

3. Interaction or exchange. An ex- 
change or interaction is defined as a thera- 
pist statement followed by a patient state- 
ment, or vice versa. It may consist of 
several propositions but it represents a 
complete interaction. The number of ex- 
changes per hour or per transcribed page 
is the "rate of interaction" and provides a 
measure of the frequency with which a 
therapist speaks or interacts. 

Each exchange was coded and punched 
onto a single IBM card. Since an exchange 
contains both a patient's statement and a 
therapist's statement, half of each IBM 
card was devoted to coded information 
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about the therapist statement and half to 
coded information about the patient state- 
ment. 

Grammatical Form- of Communication 

Each proposition was classified as to its 
grammatical form, or mood, as (a) de- 
clarative, (b) imperative, or (c) inter- 
rogatory. The grammatical form of a 
proposition communicates information. 
For example, the use of the question form 
supplies information as to who is expected 
to speak, and thus clarifies communica- 
tional expectations. Questions are devices 
by which communication processes may 
be initiated or set into motion. 

Affective Content of Communication 

The content of each proposition of 
either a patient or a therapist was coded 
as to (a) whether it expressed or referred 
to feeling, (b) whether it clearly did not 
express or refer to feeling, or (c) whether 
its affective content was not determinable. 
Verbal communication about affect is re- 
garded as a basic feature of psychothera- 
peutic interactions, and therapists fre- 
quently seek to get their patients to 
verbalize about feelings. Patient affective 
propositions refer to their feelings (love, 
fear, pleasure, sadness, etc.). 

Therapists themselves very rarely dis- 
cuss their own feelings; hence, when 
therapist propositions refer to affect they 
take a somewhat different form from those 
of patients. Therapist propositions were 
categorized as affective when they were 
directed toward eliciting patient affect. 

Interaction Process Categories 

Bales has developed a system of classi- 
fication which permits the scoring of every 
interaction in terms of one of 12 cate- 
gories. As he says, "this classification still 
does not catch 'content* in the usual sense 
of the term when 'content* is usually taken 
to mean the 'subject matter'; that is, the 
reference of the symbols used is the inter- 
action, in short 'what* is being talked 
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about. Our method tries to classify rather 
what we might call the 'process signifi- 
cance* of the single interaction; that is, the 
'pragmatic* significance of each act in re- 
lation to prior acts and acts expected to 
come." 2 

We condensed six of the Bales' cate- 
gories into three, in line with a suggestion 
made by Zetterberg (1955). The cate- 
gories used follow: 

1. Descriptive Propositions ask for or 
convey information. They give or ask for 
orientation, repetition, or clarification. 

2. Evaluative Propositions ask for or 
convey appraisal or statements of value. 
They give or ask for opinions, expression 
of feeling, or analysis. 

3. Prescriptive Propositions express or 
ask for directives. They give or ask for 
suggestions. 

Role System 

We are now concerned in a limited 
sense with what the proposition refers to, 
with what it is about. Our emphasis now 
is in classifying communication as refer- 
ring to the various systems or role rela- 
tionships in which the patient partici- 
pates. We are particularly concerned here 
with identifying propositions in which 
the therapist or the patient discusses their 
roles and expectations with regard to 
therapy. It was assumed that one of the 
ways in which a patient "learns" about his 
own and the therapist's roles is through 
the references which the therapist makes 
to these roles, that is, through role infor- 
mation provided by the therapist. The 
subject matter of each proposition was 
therefore classified in terms of the follow- 
ing frames of references: 

1. Primary System (the treatment). In- 
cluded in this category are patient or 
therapist propositions that refer to their 
roles during treatment and the process of 

2 R. F. Bales, personal communication to 
Conrad Arensberg. 
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therapy, and to the purposes, goals, and 
accomplishments of therapy. Examples: 

Therapist. There's no homework, no reference 

work, it's all done here. 
Therapist: Talk about it anyway even though 

you think it's unimportant. 
Therapist: Could you just take a moment to 

tell me what the specific areas are in 

which there has been help? 
Patient: Isn't a therapist able to tell me a 

thing like this? 
Patient : I want to be cured. 

2. Secondary System. Included in this 
category are propositions in which the 
manifest content refers to therapist and 
patient in other than their primary roles 
as patient and therapist. Transference 
phenomena fall into this category. 

3. Tertiary Systems. 

a. The family. Included in this cate- 
gory are propositions that refer directly to 
the patient's status in the family system. 

b. Other social systems. Included in 
this category are propositions that refer to 
specific social systems other than the 
family. The actual person or group must 
be mentioned. 

4. The Self. Included in this category 
are references to life experiences past and 
present that do not refer directly to other 
reference systems. (Note: In order to save 
space, illustrations of units and categories 
employed are omitted, with one excep- 
tion.) 

Categories Used in Data Analysis 

Units of Quantity : 

( 1 ) Proposition 

( 2 ) Statement 

(3) Exchange 

Categories of Informational Specificity: 

( 1 ) Passive encouragement 

( 2 ) Active encouragement 

( 3 ) Limits to subject matter area 

(4 ) Limits to specific old proposition 

( 5 ) Introduces specific new proposition 

(6) Interpretation 

( 7 ) Limits to specific answer 

( 8 ) Excludes discussion 
Grammatical Form of Propositions: 

(1) Declarative 

(2) Imperative 

( 3 ) Interrogatory 



Affective Content of Propositions : 

( 1 ) Expresses or refers to feelings, affective 

( 2 ) Does not refer to feelings, nonaffective 

( 3 ) Affective content indeterminable 
Interaction Process Categories: 

(1) Descriptive 

(2) Evaluative 

(3) Prescriptive 

Role System Reference Categories: 

( 1 ) Primary System Information 

( 2 ) Secondary System 
( 3 ) Tertiary System 

(4) The Self 

FINDINGS 

Differentiation 

Figure 1 shows that therapist behavior 
characterized as orientation (asking for 
and giving information, clarification, and 
confirmation) decreases through the first 
50 hours of therapy, while evaluative be- 
havior (asking for and giving opinion, 
evaluation, analysis, and expression of 
feeling) increases and then appears to 
reach a plateau. In general, we found that 
the pattern of differentiation among the 
therapists was more nearly analogous to 
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Sub-periods within the first 50 sessions 

Figure 1. Patterns of temporal differentia- 
tion over 50 sessions of therapy: therapist ori- 
entation and evaluation propositions. The five 
subperiods are: (1) Sessions 1-3; (2) Sessions 
4-6; (3) Sessions 7-8; (4) Sessions from the 
third and fourth months of therapy; and (5) 
Sessions from the fourth to the seventh months 
of therapy. The vertical broken line is used to 
call attention to the fact that the later two 
groups of sessions are not consecutive with the 
earlier sessions (# = 101 sessions or 9,282 
therapist propositions and 32,231 patient 
propositions). 



224 



RESEARCH IN PSYCHOTHERAPY 



that of the participants in problem-solving 
groups. 

When we examined psychotherapeutic 
communication from the point of view of 
system referent, we discovered that there 
was a very consistent downward trend, 
over the life of therapy, in the frequency 
of primary system references (see Figure 
2). The decrease was of considerable 
magnitude, dropping to less than one 
half of the original amount by the fourth 
month of treatment In other words, as 
therapy progressed, discussion about 
therapy itself and the reciprocal therapist- 
patient roles decreased. 

The decrease in communication about 
the primary role system occurs for our 
study group as a whole and appears as a 
trend in every one of the eight therapist- 
patient pairs. It reflects the inevitability 
of socialization as a consequence of psy- 
chotherapy irrespective of the orientation 
and skill of the therapist and the psycho- 
logical problem of the patient. To resolve 
the problem of what a patient may expect 
and what may be expected of him appears 
to be an indispensable requisite for main- 
taining the therapeutic system from one 
session to the next. 

Concomitant with the decrease in dis- 
cussion about therapist-patient role expec- 
tations, both the therapist and the patient 
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Figure 2. Patterns of temporal differentia- 
tion over 50 sessions of therapy: therapist and 
patient primary system propositions. See Fig- 
ure 1 for specification of subperiods and size 
of #, 
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Sub-periods within the first 50 sessions 

Figure 3. Patterns of temporal differentia- 
tion over 50 sessions of therapy: see Figure 1 
for specification of subperiods and size of n. 

tend to increase their communications 
about affect (see Figure 3). This means 
that, as therapy proceeded, the therapists 
increased the frequency with which their 
propositions inquired into and solicited 
patient verbalization about feelings, and 
also that our patients began to verbalize 
more voluminously about feelings. 

Similarities between Patterning of the 
Session and of Therapy 

A question of particular interest is 
whether the type of differentiation ob- 
served over the longer time periods of 
therapeutic interaction is similar to that 
observed during more limited time periods 
such as the length of one therapeutic ses- 
sion; in other words, insofar as differentia- 
tion is concerned, does the single session 
represent a miniature of therapy as a 
whole or do variations in the length of 
the interaction between participants even- 
tuate in variations between the macro- 
and micropatterns of differentiation? 

Most striking among the similarities 
between movement of communication in 
the individual session and movement dur- 
ing the first 50 sessions of therapy is the 
decrease of primary system communica- 
tions on the part of the therapist and pa- 
tient within the individual session. In 
other words, primary role communication 
is more frequent at the beginning of each 
hour than toward the end. 

It appears as if induction into the pa- 
tient role is a task which frequently has 
to be resumed at the beginning of each 
session. It is only after some discussion of 
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the therapist-patient primary relationship 
that the patient can once again assume the 
patient role. 

Interdependence 

We correlated patient and therapist 
treatment sessions with respect to three 
dimensions of communicative acts (i.e., 
primary system references, evaluative and 
affective references). We found increas- 
ing similarity of patient and therapist be- 
havior over time with respect to three 
dimensions of communication, i.e., pri- 
mary system communications, evaluative 
communication, and affective communica- 
tion (Table 1). We are using the term 
"similarity" to refer to the increasing 
correlation over time between specific 
kinds of patient and therapist communica- 
tions. For example, while the correlation 
between percentage of therapist and pa- 
tient affective propositions is .23 for the 
first two sessions, this correlation increases 
to .70 by the third and fourth month of 
psychotherapy. 

This finding raises an interesting ques- 
tion. The data show that during therapy 
there is a growing similarity in verbal 
behavior between therapist and patient, 
i.e., they become more alike in terms of 
the categories of verbal expression they 
employ to describe their thoughts, feel- 
ings, and action. The theoretical implica- 
tions the finding raises is whether a grow- 

TABLE 1 

INCREASE IN SIMILARITY OF THERAPIST 

AND PATIENT BEHAVIOR OVER TIME 

("=48 sessions) 

Correlations between percent of 
therapist and patient propositions 

Two sessions 

Sessions Sessions from 3rd and 
1 and 2 5 and 6 4th months 

Primary system .72 .66 .88 

Evaluation .36 .45 .58 

Affect .23 .43 .70 



ing similarity in the verbal formulation 
of experience also implies a growing simi- 
larity in more lasting and deeper aspects, 
such as: patient perception of experience 
and patient value system. 

The above relationship is a particularly 
interesting illustration of increasing inter- 
dependence between therapist and patient 
verbal behavior in therapy. However, any 
kind of regularity in the relationship be- 
tween given types of therapist/patient 
communication reflects interdependence 
rather than random variability. In this 
sense, all of our findings bear on the con- 
ception of therapy as a two-person inter- 
action system. Our work in the informa- 
tional exchange aspects of therapy which 
we cannot present in detail here is rich in 
illustrations of such regularities. For ex- 
ample, therapist statements of low spe- 
cificity consistently yielded a greater num- 
ber of patient propositions than high- 
specificity statements, while therapist high 
specificity reduced the likelihood that pa- 
tients would change the topic under dis- 
cussion. As patient output falls, therapist 
specificity increases (Lennard & Bernstein, 
I960, pp. 131-149). 

Since interdependence appears the most 
obvious attribute of behavior systems (as 
a matter of fact it is the attribute of such 
systems which makes possible their sys- 
tematic study), its discussion can be cut 
short in order to turn to more controver- 
sial aspects of the therapy system. 

Equilibrium 

We believe the concept of equilibrium 
to be as applicable to psychotherapy as it 
is to other interaction systems. The ten- 
dency of a system to maintain "a steady 
state" manifests itself in psychotherapy by 
the presence of limits within which cer- 
tain system variables fluctuate. 

When we examined this hypothesis for 
a communicational variable such as inter- 
action rate the pace at which therapist 
communications and patient communica- 
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tions follow upon one another (measured 
by averaging the number of interactions 
per transcribed page) we find very little 
variation from session to session for any 
given therapist-patient pair. For example, 
the interaction rate ranges among differ- 
ent pairs from a high of 10 interactions 
per transcribed page for one patient- 
therapist pair to a low of 1.2 interactions 
per transcribed page for another therapist- 
patient pair. In contrast, however, the in- 
teraction rate for each therapist-patient 
pair varied very little from session to 
session. In four of our cases, the standard 
deviation in interaction rate from session 
to session was only 1.1. The highest stand- 
ard deviation was 1.8. The pace of the 
interaction, therefore, appears to be fairly 
stable and varies very little over time for 
any given therapist-patient pair. 

Each session as a part of the system of 
therapy is related to the preceding and 
succeeding session. We now wanted to 
ascertain whether disequilibrium or strain 
occurring within one session affected the 
structure of communication occurring 
within the subsequent session. In order to 
study such sequential compensating proc- 
esses, it was first necessary to decide how 
to characterize sessions as to extent of 
strain present; to develop hypotheses as 
to what communicative acts could restore 
equilibrium in subsequent sessions; and 
then to examine our data. 

As one indicator of session strain, we 
considered the number of silences per 
session. A large number of silences in a 
session may reflect a breakdown of com- 
munication, or a "resistance." During 
some silences, productive "internal com- 
munication" or reverie takes place, but it 
seemed likely that sessions containing 10 
or 20 extended silences were sessions in 
which verbalization was impaired (a 
pause was not counted as a silence unless 
it was over 10 seconds in length). 

We classified 66 sessions (for which 



every immediately following session had 
also been coded) into high-, middle-, and 
low-silence sessions. We then examined 
the structure of communication in the 
session immediately following each ses- 
sion which had been classified. We found 
that the sessions exhibiting most silences 
were succeeded by sessions characterized 
by a higher percentage of therapist evalua- 
tive acts and therapist acts of high infor- 
mational specificity. In fact, for each pair, 
the sessions with the most silences were 
followed by sessions with a higher average 
percentage of therapist evaluation than 
those with the least silences. The finding 
is reported in Table 2. 

Primary System Reference as an 
Equilibrium Maintaining Mechanism 

Primary system references are proposi- 
tions in which the therapist and patient 
discuss problems relating to what therapy 
is all about. We discuss elsewhere the im- 
portance of role learning in psycho- 
therapy. The patient has to learn a new 
set of expectations appropriate to his 
function as a patient in the therapeutic 
relationship. When a patient's initial ex- 
pectations are not met, he experiences 
disappointment and/or frustration. 

Primary system references center around 
role discussion. The more primary system 
references on the part of the patient, the 
more information the patient is soliciting 
about his role in treatment. The more pri- 
mary system references on the part of the 
therapist, the more the therapist is teach- 
ing the patient his role in therapy. Pri- 
mary system references therefore reduce 
strain and disequilibrium by clarifying 
role expectations and reducing the lack of 
complementarity between the patient's 
and the therapist's conceptions of therapy. 

This role teaching seems to pay off in 
terms of patient learning. Figure 4 is a 
graph showing the average number of pri- 
mary system propositions spoken per 
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TABLE 2 

THERAPIST EVALUATIVE PROPOSITIONS IN SESSIONS 
FOLLOWING HIGH AND LOW SILENCE SESSIONS 

(n = 64 sessions) 



Proportion of therapist evaluative propositions in the next session 


Number of 
silences in 
session 


Therapist 
A 
Patient 
1 


Therapist 
B 
Patient 
1 2 


Therapist 
C 
Patient 
1 2 


Therapist 
D 
Patient 
1 2 


All 
therapists 


High 
Low 


.19 
.18 


.52 .38 
.40 .28 


.24 .19 
.09 .14 


.25 .34 
.12 .31 


.29 
.22 



session by the two more active therapists 3 
(solid line), by the two more passive 
therapists (dash-dot line), by the patients 
of the more active therapists (dash line), 
and by the patients of the more passive 
therapists (dotted line) through four time 
periods. The first three sessions comprise 
the first time period, the next three sessions 
comprise the second time period, sessions 
seven and eight comprise the third time 
period, and the final time period is made 
up of a sample for each dyad of three 
sessions taken from the third and fourth 
months of therapy. There are three impor- 
tant contrasts to be noted in Figure 4. First, 
we see that the active therapists allot many 
more propositions during the early ses- 
sions to discussion of therapist-patient 
roles than do the passive therapists. Sec- 
ondly, while the active therapists produce 
more primary system propositions than do 
their patients, the passive therapists pro- 
duce less primary system propositions 
than their patients. This appears to mean 
that the active therapists take the lead in 
discussing therapist-patient roles, while 
passive therapists seem to avoid role dis- 
cussion even when their patients intro- 
duce it. Thirdly, we see that for the dyads 

3 Therapist activity is measured by a series 
of quantitative and qualitative indicators such as 
volume and rate of verbalizations, proportion 
of evaluative and prescriptive communication, 
etc 



in which there is an active therapist, the 
amount of role teaching that occurs is 
initially large but diminishes rapidly, be- 
coming very low in the last time period; 
while for dyads in which there is a passive 
therapist, the amount of role discussion 
remains about the same from the third to 
the fourth time period. 

Of special interest are the curves of the 
patients. It can be seen in Figure 4 that 
the amount of role discussion engaged in 
by the patients of the active therapists is 
initially much higher than the amount of 
role discussion engaged in by the patients 
of the passive therapists. By the fourth 
month of treatment, however, the situa- 
tion is reversed. At that time, the patients 
of the passive therapists are engaged in 
about twice as much primary role system 
discussion as the patients of the active 
therapists. 

We suggest that therapy achieves its 
"role learning goals" to the extent that the 
patient is able to transfer what he has 
learned about role patterns in therapy to 
other significant role relationships. We 
assume that a decrease in the amount of 
communication devoted to the therapist- 
patient relationship, occurring after 
therapy has been underway for some time, 
implies some resolution of the problems 
posed by the primary patient-therapist 
role relationship. It may be a sign that 
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"deutero-role learning" has occurred; that 
is, that the patient has recognized the 
similarity and generic relevance of the 
dimensions of the therapist-patient role 
to other role relationships, 

The Expectation-Communication System 

We suggest, as a minimum, that a social 
system be conceived of as involving two 



subsystems, that of communication and 
that of expectations. Each system can be 
treated separately from the other and this 
is what we have done so far. We will now 
take up some of the interrelations be- 
tween the systems of expectation and 
communication. We will try to document 
the hypothesis that asymmetry in the sys- 
tem of expectations (dissimilarities in 
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Figure 4. Mean number of primary system propositions per session for active and passive 
therapists and their patients over time. The designation "3rd and 4th" refers to a sample of 
three sessions for each dyad from the third and fourth months of therapy (# = 88 sessions). 
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role expectations) is reflected in asym- 
metry in the system of communication 
(communicational strain), and we will 
try to show how efforts are made in the 
latter system to resolve strain created by 
the former. 

We will now present data regarding 
the effect upon therapist communica- 
tion of dissimilarities in one dimension 
of therapist-patient conceptions that of 
"activeness." 

An index of dissimilarity in concep- 
tions of activeness was constructed based 
on five parts of a question asked both of 
therapist and patient at the beginning of 
therapy. The value of the index ranges 
from 010, with indicating complete 
similarity and 10 the highest possible dis- 
similarity. Table 3 shows the effect of 
dissimilarities in therapist-patient "active- 
ness" expectations upon the occurrence of 
therapist primary system (socializing) 
communications during the first three 
hours of therapy. 

We observe in Table 3 that our hy- 
pothesis is strongly documented. Com- 
paring the two patients for each therapist, 
we find that whenever there is more dis- 
similarity with respect to activeness ex- 



pectations, there is a greater numoer ot 
therapist primary system references. We 
conceive the emergence of "role" infor- 
mation to be a direct consequence of dis- 
symmetry in expectations. For purposes of 
dealing with this problem, we regard dis- 
symmetry of expectation as one kind of 
disequilibrium and communication cen- 
tered around the primary system as one 
form of attempted re-equilibrium. 

Satisfaction and the Structure of 
Communication 

Proceeding with our analysis of the 
interrelationships between expectations 
and communication, we attempted to dis- 
criminate between the communication 
that occurred in sessions that patients 
rated as more satisfactory and those that 
patients rated as less satisfactory. 

Satisfaction with communication is re- 
lated not only to the occurrence of specific 
content but also to the process of com- 
municating. We hypothesized that strain 
in communication results not only from 
lack of consensus on subject matter, but 
also from disequilibria in the patterning 
and flow of communication itself. 

In this section we shall report on the 



TABLE 3 

DISSIMILARITIES BETWEEN THERAPIST-PATIENT EXPECTATIONS WITH REGARD TO 

THERAPIST ACTIVENESS AND THERAPIST PRIMARY SYSTEM REFERENCES 

(# = 24 sessions) 



Therapists 


Patient 


Index of 
dissimilarity 
(ranging from 0-10 
High = Dissimilar) 


Proportion of 
therapist primary 
system references 
during first three 
hours of therapy 


Therapist A 


1 
2 



2 


.09 

.27 


Therapist B 


1 
2 


1 

3 


.16 
.49 


Therapist C 


1 
2 


2 
3 


.05 
.20 


Therapist D 


1 
2 


3 
4 


.15 
.19 
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relationship between patient ratings of therapists were more active, more specific, 
ease of communication during psycho- more concerned with affect, etc. were rated 
therapy sessions and some of the actual as more satisfactory. These hypotheses re- 
characteristics of the verbal interchanges late to two questions: how disappoint- 
in those sessions. ment was diminished, and how satisfac- 

Table 4 summarizes ten variables dif- tion was increased. 

ferentiating the sessions rated as proceed- 1. The pattern of communication in 
ing "more easily" from those rated as pro- the more satisfying sessions is more nearly 
ceeding "the same" or "less easily." It similar to that of ordinary social relation- 
should be borne in mind that the ratings ships, and so is more in line with the pa- 
of satisfaction obtained from our patients tient's previous experience, 
are comparative or relative ratings rather 2. In the previous professional inter- 
than absolute ratings of patient satisfac- actions in which the patients have partici- 
tion. pated, the professional participant prob- 

We shall now offer some general hy- ably has assumed a role more active and 

potheses about why the sessions in which reciprocal than that of a therapist. Thera- 

TABLE 4 

DIFFERENCES IN COMMUNICAtlONAL STRUCTURE AMONG SESSIONS* 
(# = 23 sessions) 



Description of 
variable 


For sessions rated 
as proceeding 
"more easily" 


For sessions rated 
as proceeding 
"the same" or 
"less easily" 


1. Average number of therapist propositions 






per session 


90 


4G> 


2. Average number of patient propositions 






per session 


305 


242* 


3. Average ratio of therapist to 






patient propositions 


.29 


.19 


4. Average number of exchanges per session 


52 


34 


5. Proportion of therapist propositions 






that are questions 


.30 


.37* 


6. Proportion of therapist propositions 






that are highly specific 


.37 


.23* 


7. Proportion of statements in which patient 






changes the subject 


.20 


.28 b 


8. Proportion of therapist propositions 






that are affective 


.40 


.21" 


9. Proportion of patient propositions 






that are affective 


.27 


.23 


10. Ratio of therapist to patient 






affective propositions 


.41 


.18 



a All the differences reported below hold for each therapist taken separately, except for the case 
of one therapist with reference to one variable (Items 8 and 9). This internal consistency in the 
findings is perhaps a more valid test of significance than the formal tests presented below. 

b Difference significant at .01 level (student's 'V distribution, two-tail test) . 

Difference significant at .05 level (student's 'V distribution, two-tail test). 
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pist behavior thus deviates from what the 
patient expects of a professional man ren- 
dering service. 

3. The transference manifestations of 
therapy prompt the patient to expect the 
therapist to ' give" to the patient. Verbal 
output on the part of the therapist may 
be interpreted as a "gift" from the thera- 
pist. Therapist passivity and lack of par- 
ticipation is equated with rejection and 
reacted to with frustration. 

4 The patient's substantive problem is 
that of disorientation with respect to the 
major role systems in which he partici- 
pated outside of therapy. Therapist feed- 
back in the form of verbalization, inter- 
action, and informationally specific inter- 
ventions counters this disorientation and 
increases a sense of satisfaction. 

5. Increase in order and continuity in 
the flow of communication contributes to 
a sense of achievement and satisfaction. 

6. Increase in affective concern on the 
part of the therapist gives the patient a 
sense of being understood. Abreaction and 
catharsis of feelings contribute to the 
patient's feeling of satisfaction. 

CONCLUSIONS 

There are three types of remarks with 
which I should like to conclude this par- 
tial summary of the psychotherapy re- 
search conducted at Columbia University's 
Bureau of Applied Social Research: (a) 
First, I will suggest a few of the implica- 
tions of our research, limited as it is. 
(b) I will draw attention to the further 
work which will still have to be done 
within the same or a similar conceptual 
framework, i.e., psychotherapy as an ac- 
tion system, (c) I will outline briefly 
some aspects of the therapeutic relation- 
ships (not dealt with in our work) which 
require intensive study at this time espe- 
cially with methods of content and process 
analysis. 

a. A Few Implications, We found that 



despite major differences in the outlook 
and the behavior of each therapist and 
each patient, there are major similarities 
among therapist-patient pairs in terms of 
the way the interaction unfolds longi- 
tudinally. This finding raises questions for 
those who tend to stress differences be- 
tween therapists in their theoretical orien- 
tation and who emphasize the importance 
of the "school*' to which a therapist be- 
longs as the determinant for what tran- 
spires during therapy. 

Within limits, it appears also that the 
requirements of the system take prece- 
dence over expectations and conceptions 
of therapeutic roles. Much of this occurs 
outside the awareness of the therapist. 
Often, the realization that he is departing 
from a preconceived therapeutic position 
in the interest of maintaining the system 
follows upon, rather than precedes, the 
"system-sensitive" act. We believe that 
this question of system sensitivity versus 
theory orientation may have major impli- 
cations for the training of therapists. 

One way of looking at the relationship 
between our focus on interaction and the 
analytic exploration of therapy as a situa- 
tion in which unconscious strivings are 
manifested rnay be put in this way: What 
is latent for the personality system are 
"unconscious processes," while what is 
latent for the social system are "system 
processes." By making the patient con- 
scious of these hitherto unconscious per- 
sonality processes, the therapist increases 
the patient's adaptive control and flexi- 
bility. The identification of system proc- 
esses can serve a very similar function for 
the therapist. By enlarging the therapist's 
awareness of the processes taking place 
in the therapeutic systems in which he 
participates, one may make possible an 
increased measure of responsiveness and 
control on his part. 

b. Further Research within the Same 
Conceptual Framework. In the study of 
psychotherapy reported in this paper, the 
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therapist-patient relationship was viewed 
as a system, and the concept of homeo- 
stasis or dynamic equilibrium was utilized. 
It turned out to be useful in explaining 
consistent changes in behavioral patterns 
of therapist and patient. On the basis of 
the analysis of the data at our disposal we 
agree wholeheartedly with the biologist 
Emerson (1956) who recently said: "At 
the present time, at least, homeostasis is 
a remarkably adequate concept for quan- 
titative measurement. Through this con- 
cept we can make comparisons between 
phenomena that, without it, are very diffi- 
cult to compare, because we don't have a 
quantitative relationship in quantitative 
terms that is applicable to different phe- 
nomena." 

Yet upon further reflection, it has oc- 
curred to us that there are further aspects 
of the concept which could be explored 
with the type of data we have gathered or 
similar types of data. Questions of the 
kind raised by James Miller (1956) with 
respect to a variety of systems could be 
meaningfully raised with respect to 
therapy. Given eight therapist-patient sys- 
tems (four therapists with two patients 
each), one might wish to determine which 
of eight therapeutic systems tends most 
toward homeostasis, which the least. A 
number of criteria proposed to determine 
the degree of homeostasis in systems in 
addition to those already explored could 
be investigated in relation to psycho- 
therapy. For example, Deutsch suggests 
that a System A is more homeostatic 
(than System B) if the average deviations 
from the level to be maintained are 
smaller. An analogy may illustrate this 
criterion. If there is too much "play" in 
the wheel of a car, the task of moving the 
car straight ahead is more difficult; the 
correction to be introduced by the driver 
is larger. In general, the steering mechan- 
ism of a system has to work harder when 
system parameters fluctuate more widely. 
In the course of our psychotherapy re- 



search, we determined a number of 
parameters of therapist and patient be- 
havior and expectations. With respect to 
these, we are now in a position to assess 
which therapist-patient systems show 
most fluctuation, which least. 

A number of other questions to be 
answered on the basis of our data follow: 
Are any two systems in which one thera- 
pist participates similar with respect to 
stability or instability? Are some thera- 
peutic systems more stable within smaller 
time periods; others within longer time 
periods? If we define homeostasis, as 
Ashby suggested, as the tendency of sys- 
tems to maintain their "essential variables 
within physiological limits,"* the question 
arises as to what are the specific social 
system's equivalent limits to that, say, of 
body temperature system. What are the 
limits within which ratios between fulfilled 
and unfulfilled expectations or satisfactions 
and frustrations may vary without damage 
to the system or its component units? 

There exists theoretical controversy 
about what degree of frustration is within 
"optimal limits" of the therapeutic and 
especially the analytic treatment system. 
Similar controversy, interesting enough, 
also exists with respect to dimensions of 
satisfaction and frustration in sociological 
literature on industrial systems. 

Another hypothesis to be explored on 
the basis of the available psychotherapy 
study data states that systems become 
more homeostatic if the oscillations of 
the system variables around the main- 
tained level decrease in magnitude. Our 
data suggest that at least with reference 
to verbal activity variables, such a de- 
crease in the magnitude of oscillations 
does indeed occur as therapy proceeds. 
This hypothesis, however, stiU needs in- 

4 1 am indebted to the very provocative com- 
ments by Emerson, Deutsch, Grinker, Rapa- 
port, and others reported in Grinker (1956) 
as well as to Miller's (1956) stimulating re- 
view of this book for some of the ideas ex- 
pressed here. 
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vestigation with respect to a large number 
of therapist-patient parameters. If further 
support for this hypothesis is forthcoming, 
the question arises as to what accounts 
for such increase in homeostatic control 
in systems. One may suggest that increase 
in homeostasis occurring in therapy as 
well as in social systems in general may 
be attributed to "learning." We suspect 
that the crucial type of learning involved 
in social systems (and the therapy system 
is considered such a system) is "role 
learning" or socialization. Two other gen- 
eral formulations with regard to system 
homeostasis may be worthy of application 
and exploration with regard to the therapy 
system. One states that System A is more 
homeostatic than System B if the range of 
loads which will not throw it out of gear 
is larger. The second formulation would 
attribute more homeostasis to System A 
than System B if learning in System A 
proceeds in such a fashion that one range 
of loads can be dealt with better or that 
larger loads can be dealt with better. 

The relevance of these formulations to 
biological self -regulating systems in par- 
ticular is unequivocal. Consider, for ex- 
ample, environmental temperature as con- 
stituting a load on the organism. To the 
extent that one organism can maintain a 
steady state of body temperature more 
efficiently than another, despite extremes 
of environmental temperature, to that ex- 
tent we are justified in describing the 
temperature regulating system of that or- 
ganism as more homeostatic. Learning to 
deal with loads on the part of biological 
systems is illustrated by the increase in 
the body's oxygen carrying red corpuscles 
in high altitudes, which re-establishes for 
the organism an equilibrium between 
oxygen requirements and oxygen availa- 
bility. 

How would one compare therapeutic 
systems with respect to the criteria out- 
lined and illustrated above? Consider the 
patient who arrives in the therapeutic 



session in great distress; who refuses or 
is unable to continue with the therapeutic 
task, who is crying or unwilling to verbal- 
i2e. In such sessions basic parameters of 
therapist and patient behavior may oscil- 
late widely around the usual ratios main- 
tained. Though these oscillations in them- 
selves reflect mechanisms of repair, just 
as fever is a restorative effort on the part 
of the organism, one would consider sys- 
tems which show less oscillation under 
such conditions more homeostatic. The 
goal of therapeutic systems could be de- 
fined as restoration of smoother equilibri- 
ating patterns, just as one of the organ- 
ism's goals can be conceived of as restora- 
tion of "normal" temperature variation. 
One would further assume, but would 
need to test empirically, that similar dis- 
tress (load) experienced by the patient 
during a later phase in therapy would not 
result in such oscillation. 

The same type of "load" (arising from 
an environmental or intrapsychic source) 
does not nearly disequilibriate the thera- 
pist-patient system as much when it 
occurs later in therapy. There may be con- 
siderable discussions of the issue in 
therapy now; a great deal of affect may be 
expressed by the patient about it, but the 
patient is verbalizing freely and the task 
of therapy proceeds. The "input" on the 
patient has now become "grist for the 
therapeutic mill." 

If our assumptions are borne out, then 
what has happened between Time 1 when 
homeostasis was threatened and Time 2 
when therapy system homeostasis is not 
threatened nearly as usual? Obviously, the 
time that the patient has been in therapy 
has intervened; the patient has partici- 
pated in the system for a longer span of 
time. Through this participation he has 
learned some dimensions of the patient 
role. And an important component, for 
example, of this role would be learning 
of the requirement that whatever happens, 
the patient is to verbalize his feelings, 
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ideas, reactions, etc. To the extent that the 
patient has learned this dimension of the 
role, to that exent the system will now be 
more homeostatic Intensifying research 
on therapy in system terms is expected 
not only to contribute to the clarification 
of therapeutic processes but also to add to 
an understanding of social systems as such. 

c. Suggested Directions for Psycho- 
therapy Research Employing Content 
Analysis. With respect to the number of 
variables involved, die levels at which they 
can be examined and studied, the range 
and extent of their interrelatedness, and 
the changes and movement in the inter- 
relationship, a social relationship such as 
therapy may indeed present problems of 
the same order of complexity as posed by 
the study of the human organism. In 
David Shakow's (1959) words, 'There 
are perhaps thousands of parallel proc- 
esses going on during the process of a 
relatively short time of therapy." Even a 
preliminary inventory of the types of 
studies which should be undertaken must 
be postponed for decades and may involve 
concepts and methods far different from 
the ones we are familiar with today. 

It may well be that studies of the thera- 
peutic process will in the future be sub- 
sumed under studies of personal influence 
processes per se and that the identification 
of general principles governing the way 
in which one individual changes another 
through communication will precede the 
identification of the more specific prin- 
ciples governing the therapeutic relation- 
ship. 

At this point, however, I want to use 
this opportunity to outline some areas in 
which current research efforts may be in- 
tensified. My remarks will be limited to 
analyses of data obtained from the study 
of the therapy situation rather than data 
obtained through the study of patients or 
therapists in contexts other than that of 
therapy: 



Studies of the Flow of Verbalization during 
Therapy 

Studies of the flow of verbalizations (asso- 
ciations) as they occur, especially in psycho- 
analysis or psychoanalytically oriented psycho- 
therapy, have been proposed for a great many 
years, but to my knowledge have not been 
systematically and comprehensively under- 
taken. I am not thinking of studies which fol- 
low mention of specific topics or persons 
(father, mother, etc.) over a span of sessions, 
though these are informative. 

I am suggesting the value of studying the 
changing structure of sequences of verbaliza- 
tions on the part of the patient as he progresses 
through therapy. This can be done from many 
points of view: 

From the point of mew of analytic theory: 
Menninger (1958), as other psychoanalytic 
theorists, has offered a general formulation 
about the types of verbalization sequences 
which signal a "properly going" analysis. In 
such an analysis, he writes: 

The patient will usually describe, for ex- 
ample, an aspect of the reality situation 
which he finds to be unpleasant, and from 
this go to certain aspects of the analytic situ- 
ation which he may find either pleasant or 
unpleasant, but probably pleasant in contrast 
to the unpleasantness of the reality situation. 
Under the aegis of this pleasant aspect of the 
analytic situation his mind reverts to child- 
hood and he recalls something from this area 
neither the earliest nor the most recent 
thing, but something related. From this he 
soon turns again to the present, to something 
in the contemporary reality situation and a 
cycle will have been completed. Formula: 
Reality Analysis Childhood Reality ( p. 
151). 

Without going into the many questions which 
this statement raises, it nonetheless affords an 
opportunity for some kind of assessment of 
the associational stream. Hypotheses framed on 
this level permit empirical investigation 
through currently available content analytic 
and data processing methods. Thus, sequential 
arrangement of patient verbalizations refer- 
ring to childhood, the analysis, and reality 
could be established. 

Changes in the Proaction Patterns 

Our current research on "psychotherapy as 
a system" has turned up some tentative sugges- 
tions as to the way in which patient verbaliza- 
tion sequences change. For example, when 
sentences are considered as the consecutive 
units of verbalizations, there appears a tendency 
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for patient sentence sequences occurring later in 
the sessions to resemble in some respects 
therapist-patient sentence sequences of early 
therapy sessions. We have so far investigated 
this trend only with respect to the descriptive, 
evaluative affective, and nonaffective character- 
izations of verbalizations. For an expansion of 
such research, data processing procedures are re- 
quired of which we have not yet availed our- 
selves. Analysis of substantive sequential changes 
in speech references seems worthwhile for study- 
ing the effects of dialogue upon monologue in 
the sense of "internalization of language inter- 
action patterns." 

Changes in Interaction Sequences 

Research so far has yielded both molar de- 
scriptions of therapist-patient relationship over 
one session or a series of sessions and more 
atomistic descriptions of therapist-patient be- 
havior on an act-to-act level. The attempt to 
describe therapy in terms of the way series of 
therapist-patient acts are strung together in 
longer sequences still needs to be made. 

In describing changes in the patterning of 
interaction, we also are handicapped by the 
lack of appropriate conceptual categories of 
description. While language appropriate to de- 
scribing the therapist-patient relationship dur- 
ing one session is available from a variety of 
psychiatric and psychological theories, and while 
we can borrow from small group theory and 
research to describe a succession of acts, it ap- 
pears to me that description of more complex 
sequences requires the development of a new 
set of concepts and categories. The descriptive 
level required might perhaps be pointed to by 
terms such as "thematic continuity," "affective 
congruence," etc. 

Concept Learning and Concept Formation 

Changes in the vocabulary of the patient 
occurring in the course of therapy have often 
received comments by clinicians. Notice has 
been taken of the frequency with which cer- 
tain words are used, changes in the form of 
sentences (see documentation of this in sec- 
tions on Interdependence and Equilibrium), 
etc. Verbalizations express concepts available 
to the patient to describe and interpret feel- 
ings and thoughts, experiences and behavior. 
The changing structure of verbalization 
throughout therapy can be studied for "con- 
cept formation and learning." How concept 
learning can be assessed from verbal data ob- 
tained in a nonexperimental context represents 
a challenge yet to be met. If a patient, for ex- 
ample, characterizes as related a number of 



behaviors and subsumes them under one de- 
scriptive heading (dependent), when he had 
not done so previously, has he learned the 
concept of "dependency"? One would wish 
that psychologists concerned with studying con- 
cept formation in the Piaget tradition would 
take up this challenge. 

The Learning of Role Dimensions 

One focus of the research described in this 
paper (which I could not outline due to limi- 
tations of space) was the consideration of the 
psychotherapy situation as a deutero-learning 
situation. 5 Deutero-learning occurs in the 
psychotherapy situation both in a general and 
in a specific manner. A patient's generic prob- 
lem could be conceived of (among other 
things) as an inability to function adequately 
within major social role systems (family, occu- 
pational, and other systems). In other words, 
the patient is not properly socialized into his 
diverse roles and has not acquired sets of 
expectations and behaviors that would permit 
social interaction to proceed smoothly. Our 
hypothesis would be that in therapy the patient 
not only "learns" a set of expectations appro- 
priate to the therapeutic relationship and how 
to behave in accordance with such expectations, 
but in learning this according to the deutero- 
learning concepts he acquires insight into the 
principles underlying the learning of role ex- 
pectations in general. These principles are then 
available for use in learning or relearning other 
patterns of expectations governing relationships 
in which he participates. The learning of role 
expectations becomes a particularly apt focus 
for analysis of verbatim transcripts since, as a 
result of the insistence of most therapists for 
patients to verbalize thoughts and feelings, the 
manifest content of verbalization is to a con- 
siderable extent concerned with the expression 
of expectations, discrepancies in expectations, 
and their resolution. 

Communication of Values 

While a great number of papers have been 
written on whether, how, and which values 
therapists communicate to patients, there is, 
with a few interesting exceptions, a dearth of 
empirical research with regard to this problem. 

The research which has been done, however, 
does not mainly rely on material produced dur- 
ing therapy but, rather, on interviews and ques- 
tionnaires administered to therapists and pa- 
tients. The flow of sanctions both positive and 

6 For discussion of concept of deutero- 
learning, see Lennard and Bernstein (I960), 
pp. 27-30. 
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negative from the therapist to the patient, and 
their effect upon patients' communications in 
terms of their form, substance, position, etc., 
requires study. While scientists working within 
frameworks as diverse as that of the psycholo- 
gist, Skinner, and that of the sociologist, Par- 
sons, both hypothesize and document the posi- 
tion of the inevitability of therapist "influence," 
and influence toward those value orientations 
held in part by the therapist, the precise specifi- 
cation of the mechanisms whereby this is 
achieved through the process of verbal com- 
munication is still unresolved. Therapists' com- 
munications classified as sanctions would in- 
clude: explicit communications stating thera- 
pists' position, therapists' permitting the patient 
to express views usually negatively sanctioned, 
therapists' expression of verbal attention, etc. 
For example, with respect to therapists' selec- 
tive responses (an area which is receiving a 
great deal of attention from those psycholo- 
gists who stress the relevance of the "operant 
conditioning" phenomenon to psychotherapy), 
one might argue that the range of topical con- 
tent introduced and referred to by the patient 
is considerably larger than that introduced and 
referred to by the therapist explicitly. The 
therapist can neither comment nor respond to 
every topic or proposition communicated by the 
patient. He reacts to a small fraction of these. 
These reactions range from the Yes's and 
"hmmnhs" to more specific comments, in- 
quiries, and interpretations. 

The study of therapist communications with 
regard to the value context in which they are 
elicited would represent a first approximation 
toward specifying the mechanisms whereby 
values might be communicated. 

Interrelationship between Levels of Communi- 
cation: Congruence and Incongruence 

The emphasis so far has been on suggesting 
studies of verbal communication data. Although 
the verbal level is only one of many levels on 
which therapist-patient communication and in- 
fluence can be studied. Yet I disagree with 
those workers in the field of psychotherapy 
who would downgrade the study of therapist- 
patient transactions which is limited to one 
communicational level only. As researchers in 
this field, I am sure all of us have had the 
experience that when working on the verbal 
level, we are told that the nonverbal (kinesic, 
vocal, visceral, etc.) is more significant; or that 
when focusing on second-to-second changes, we 
are challenged on the neglect of more global 
relationships; or when concentrating on inter- 
action process, we are accused of neglecting 
psychodynamic content. In this paper I ex- 



pressed my feeling, shared with many others, 
of the horrendous complexity of our prob- 
lem. However, if we are to proceed, then we 
cannot work at all levels at the same time. 

It would, however, be exceedingly valuable 
to know in a general way about how much we 
lose in the study of the therapeutic relationship 
by restricting our attention to a particular level 
of intercommunication. Two hypotheses come 
to mind here, one, which asserts that different 
communications are exchanged at different 
levels (incongruence), and one which asserts 
that there is a great deal of congruence in the 
information conveyed. Studies oriented around 
this question, however crude, in particular 
would be very useful. Consider, for example, 
communications of a depressed patient on the 
level of lexical content, kinesic (body motion), 
or vocal. Are we sufficiently advanced in de- 
scribing lexical, kinesic, or vocal characteristics 
to make an assessment of congruence or incon- 
gruence? Here, then, is another area of re- 
search which I feel would bear exploration. 
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Discussion of Papers Relating to 
Definition of Variables 

DAVID SHAKOW, PH.D. 



Drs. Butler, Lennard, and Siegal, and the 
groups they represent, have made my task 
difficult and frustrating though I cannot 
but admit, enjoyable by providing us 
with three individually rich papers that 
invite much discussion. The task of deal- 
ing with them together is additionally 
difficult because the approaches are so 
diverse. But it is just this diversity of 
approach for which we should congratu- 
late ourselves. It merely points up, on the 
one hand, the complexity and multilevel 
nature of psychotherapy and, on the other, 
the general paradigmatic contribution of 
psychotherapy for all dyadic interactions. 
Since I have to be selective, I shall limit 
myself to a few theoretical points in each 
presentation and leave detailed points re- 
lating to results for the general discussion. 

Our area of concern in this session is 
threefold: 

1. Which variables in psychotherapy 
are significant? 

2. How can they be defined rigorously? 

3. How can they be measured ade- 
quately? 

To start with, let us set up the proper 
hierarchy of values. Needless to say, the 
most important of the three questions is 
the first the selection of significant vari- 
ables. Yet I am afraid that too often psy- 
chologists tackle the latter two problems 
first particularly the problem of the 
adequacy of measurement. They concern 
themselves to such an extent with meas- 
urement that they show insufficient regard 
for the importance or nonimportance of 
the variable measured. 

Before going on to a specific considera- 
tion of each of the three papers, I should 



like to make some general comparative 
comments. Although it is not easy to 
characterize any approach briefly, I think 
it is approximately correct to say that 
Lennard provides us with a formal, socio- 
logical approach, centered on the notion 
of system. The Butler approach is be- 
havioral-clinical centered on the notion of 
interaction, and that of Siegal and Rosen 
is distinctly clinical, based on inferences 
from related contemporary data in this 
case, psychological test data. The first two, 
on the contrary, base their conclusions on 
the therapy material itself. 

Lennard samples, from the various 
stages of therapy, the particular parts used 
being determined by the specific question 
asked. He makes a formal analysis of the 
therapy protocols according to certain de- 
scriptive categories. Butler, on the basis 
of naturalistic observation, develops a 
classification system, evaluates according 
to this system, and then orders his ma- 
terial conceptually with the help of factor 
analysis. For his data he depends on the 
second and next to last sessions to deter- 
mine what changes have taken place in 
the therapy. Siegal uses the inferences 
from the test data to measure the con- 
structs of anxiety tolerance, and move- 
ment along the continuum of auto-/allo- 
plasticity. He examines the patient before 
and after therapy with a battery of psycho- 
logical tests, and bases his judgment of 
the effect of therapy on this outside 
measure. 

The Butler-Lennard approaches seem to 
have more in common since they deal 
with more discrete, descriptive character- 
istics, many of which depend directly on 
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protocol material. In their present reports, 
they are also the only ones who provide 
data about interaction effects between pa- 
tient and therapist. 

Now, let me comment specifically on 
each of the papers. Butler and his group 
provide us with a careful and thoughtful 
analysis of the place of naturalistic 1 ob- 
servation and argue that the psychotherapy 
process falls into this area. The straight- 
forward acceptance of this point of view 
is in marked contrast to the efforts of 
some therapists, particularly some psycho- 
analysts, to characterize the therapeutic 
situation as an experimental situation 
(Kris; Ezriel; Reider). This borrowing 
of status, even if understandable, does not 
seem to me to serve well the needs of a 
growing and respectable field of research. 
Butler's discussion of naturalistic observa- 
tion as applied to the therapeutic situation 
is the fullest and most sensible I have 
seen. 

Although I agree with him that in gen- 
eral the function of naturalistic observa- 
tion is to generate hypotheses, I find it 
difficult to go along with him completely 
when he says, "It is not to test hypotheses. 
The testing of hypotheses is in the prov- 
ince of the experimental method and, in 
certain situations, of statistical methods. 
Generally speaking, the use of experimen- 
tal method depends upon control, and by 
control is meant the control of relevant 
conditions or variables." 

If by his inclusion of "statistical meth- 
ods" he means the post hoc manipulation 
of the naturalistic data through statistical 
devices, then perhaps we are in agreement. 
For it appears likely that it may never be 
possible to place the hypotheses derived 
from certain kinds of naturalistic observa- 
tion, for instance, the therapy situation, 
under truly experimental conditions. How- 
ever, the development of increasingly 

1 As I have said elsewhere (I960, p. 88), I 
would prefer to characteme the therapeutic 
situation as seminaturalistic. 



powerful tools of data reduction and analy- 
sis can help us to deal with what Warren 
Weaver (1948) has called "organized com- 
plexity," and the psychotherapy situation 
certainly falls into this category. This very 
meeting represents a faith that "dis-" is 
not an appropriate prefix for the first word 
of Weaver's phrase! These tools can help 
in ways which might enable us to achieve 
the control the Butler group speaks of, by 
partialling out selected variables that 
occur naturally from the immediate con- 
text of the many uncontrolled variables. 

What I am saying is that I would ex- 
tend much further than they are apparent- 
ly ready to, the limits of naturalistic ob- 
servation. I am arguing that for certain 
kinds of phenomena, where experimental 
attack might perhaps destroy their very 
nature, the combination of the powerful 
tools of prediction and computational 
partialling may provide us with data hav- 
ing equal "dignity" to paraphrase the 
Helmholtz school thesis with the experi- 
mental. It is this assumption of differences 
in dignity of approach to which I was 
referring earlier in my criticism of certain 
psychoanalysts. Both John Benjamin's 
paper "Prediction and Psychopathological 
Theory" (1959) and Weaver's "Science 
and Complexity," which I have already 
mentioned, are worthwhile reading in this 
context. 

I do agree strongly with Butler that the 
use of naturalistic observation for the de- 
velopment of hypotheses should lead to 
more refined hypotheses. However, I do 
not believe it is necessary that the more 
refined hypotheses be tested in experi- 
mental situations. I think that our new 
recording techniques, which provide us 
with "full" reports of the actual events, 
make possible this successive refinement 
of hypotheses within the actual therapeu- 
tic situation. And of still greater impor- 
tance, it permits this refinement to take 
place on exactly the same data, since these 
data, unlike those of the ordinary experi- 
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mental situation have, for all practical 
purposes, a "half -life" of infinity! 

Butler presents a good rationale for 
their classification system for the patient 
and therapist. I am impressed by the psy- 
chological sophistication of the system. 
This seems to me a distinct advance in 
formal systems. It gets at more subtle dif- 
ferentiations in human, especially psycho- 
therapeutic, interaction. It undoubtedly 
places considerably greater demand upon 
the judges for fine discrimination. How- 
ever, the human instrument has surprising 
capacities in this direction, when proper 
controls are provided for training, for 
continued training, and for checking reli- 
ability. I find the Counseling Center's use 
of "drift" records a worthwhile innova- 
tion. This deals with a generally unrecog- 
nized at least undealt with weakness 
in all evaluation systems and should go 
far to help maintain the sharpness of the 
judges. 

I like, too, the way the classification 
system is built up around a theoretical 
view in this case that therapy is "a con- 
tinuing search for new elements and the 
forming of creative recombinations of 
new and old elements," based on the 
notion that "stimulus hunger" lies behind 
what is sought for in the therapy process. 

Whether we accept exactly this way of 
putting it, I trust that the Counseling 
Center group will test their method to the 
full The therapist classification system 
with its reformulation of the impact of 
the therapist on the patient, even though 
it sometimes leaves one feeling that there 
is a built-in bias in favor of the poet as 
therapist, deserves special testing. 

Lennard provides another point of view. 
I wish to discuss two points from his 
paper: his general approach and the prob- 
lem of socialization and deutero-learning. 

With regard to his general position: I 
am glad that our Second Conference in- 
cludes an approach to psychotherapy 



which emphasizes the more formal quali- 
ties a sociologist is likely to see in an in- 
teraction situation. The sociologist cannot, 
of course, remain a narrowly defined soci- 
ologist when dealing with a psychotherapy 
situation. He must in part become a social, 
if not a clinical, psychologist! This is re- 
flected in some of the material presented 
by Lennard. But on the whole he deals 
with psychotherapy as system. The cate- 
gories used in his data analysis present in 
a general way how a person of this per- 
suasion approaches the problem. These 
categories are valuable for what they con- 
tribute; but, as Lennard himself clearly 
recognizes, they reflect only one facet or 
level of the psychotherapy situation. 

Dr. Lennard touches on one of the 
most important principles of psycho- 
therapy in his discussion of socialization 
and deutero-learning. I suppose it is be- 
cause of my differing orientation that I 
have some questions to raise about his 
views in this area. Specifically I raise a 
question about the socialization process he 
describes, the analogy he draws between, 
on the one hand, the therapist socializing 
the patient and, on the other, the parent 
socializing the child or the teacher social- 
izing the student. Taken literally, in the 
sense in which he mainly talks about the 
patient-therapist relationship, one won- 
ders whether the analogy is accurate. The 
patient-therapist relationship must be 
recognized for what it is socially really a 
very peculiar one. Not only is it of rela- 
tively short duration (except perhaps in 
Boston! ) , but it is ordinarily unlikely to 
be repeated during life. It has a distinct 
artificiality, especially as represented in 
the extreme of the psychoanalytic situa- 
tion. In itself in its formal game quality 
it has little potential for deutero-learn- 
ing. Its very strength may perhaps lie in 
the fact that the actual situation, because 
of relatively few common elements, does 
not provide a basis for transfer of train- 
ing. Is it not rather the technical trans- 
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ference aspect of the therapeutic situation 
which is the essential one for deutero- 
learning? It is the patient's own role- 
playing and his projection of roles onto 
the therapist, followed by the working 
through of this material, whether con- 
scious or unconscious, which makes pos- 
sible the real deutero-learning that the 
therapeutic situation provides. 

The concept of deutero-learning in 
itself is particularly relevant to the thera- 
peutic process. Considering its impor- 
tance, it is surprising how little attention 
it has received. Why such an obvious prin- 
ciple was not given its proper place in the 
psychology of learning until Harlow's 
paper on "learning sets" (1949) is diffi- 
cult to understand. It is true that as Bate- 
son points out in his paper on deutero- 
learning (1942), the principle was 
touched upon by several previous authors, 
notably Lawrence Frank and Norman 
Maier. Still, it was not stressed, except as 
it was involved in the concept of transfer 
of training. In the analytic concept of 
transference, we have a somewhat special 
case of deutero-learning. Presumably here 
the therapist becomes the surrogate for 
important persons in the environment of 
the patient, and therefore one has in a 
sense not so much a transfer of a general- 
ized set, but rather a transfer from actual 
practice in the role-played situation. 

Therapy seems therefore to involve at 
least three kinds of learning: (a) the 
patient-therapist role relationships learn- 
ing the rules of this game as of any game 
which on the whole have little trans- 
ferable quality; (b} the transference re- 
lationships which have a literal trans- 
ferable quality to others important in the 
patient's life and which are worked 
through verbally/affectively during ther- 
apy; (c) the more pure deutero-learning 
which carries over from the practice with 
the first two, and from the rehearsal of 
other life situations learning the patient 
generalizes to his daily life. 
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The Menninger material reported by 
Siegal and Rosen provides us with still 
another approach to the analysis of ther- 
apy. This approach does not deal with 
the interactive effect of therapist and pa- 
tient. It is deliberately limited to what 
the patient was like before and after 
therapy, not, as judged by other partici- 
pants, through an analysis of the protocol 
material, but rather through the use of 
contemporaneous psychological tests. It is 
important also to emphasize that for 
Siegal and Rosen it is not the scores on 
tests, but rather the inferences drawn from 
them by experienced psychodiagnosticians 
which serve as the basis for the study. 

From Drs. Siegal and Rosen's paper I 
should like to discuss primarily the 
method they have used and make some 
comments about the constructs of anxiety 
tolerance and auto-/alloplasticity. 

Drs. Siegal and Rosen are to be con- 
gratulated on the forthrightness with 
which they have taken a point of view 
and maintained it consistently even 
though it might not be popular in some 
quarters. They argue cogently for the 
value of taking the clinician's stand and 
using the clinician's method inference 
as the basis for evaluation. 

But must we and they not admit 
that their "clinical" approach is only a 
"modified" clinical approach. It is one 
which draws its inferences from psycho- 
logical test data rather than from therapy 
material itself. Although it has many re- 
semblances to the kind of material that 
derives from protocols, this material still 
has many fundamental differences. The 
core of the distinction can be found in the 
rationale for psychodiagnostic procedures, 
such as those used in clinical psychology. 
The psychological test devices used by Dr, 
Siegal provide at least a common basis 
from which to draw inferences. The free 
therapeutic situation, on the other hand, 
provides no such common controlled ma- 
terial across which to compare persons, or 
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even to compare a person with himself 
from time to time. The point I am making 
is not at all weakened by their argument 
with regard to the significance of context 
in evaluating responses. My feeling is 
that they protest a little too much and 
have gone overboard undoubtedly in the 
effort to make their point in arguing for 
nonconstancy in relation to scores and re- 
sponses. It is a wise clinician who keeps 
in mind that the same score may not have 
the same meaning in different contexts, 
but does not this wise clinician also recog- 
nize, with equal flexibility, that the same 
score may sometimes have the same mean- 
ing in different contexts? What is impor- 
tant, isn't it, is to maintain objectivity 
about our subjectivity! 

In choosing to concentrate on anxiety 
tolerance and auto-/alloplasticity, the au- 
thors have selected what would seem 
from general experience to be highly sig- 
nificant variables. The problems arising 
when anxiety has been used as a criterion 
of change are well discussed in the paper. 
They give sound support to their distinc- 
tion between primary and secondary 
anxiety, and the decision to use signal 
anxiety as a criterion. I was impressed 
with the description of the steps they went 
through in cleaning up the concepts and 
their arrival at a fairly rigorous definition 
of anxiety tolerance. The same holds for 
the concepts of auto-/alloplasticity. 

I was interested in the presentation of 
the four types into which their patients 
fell. I was struck by the fact that the first 
two types apparently the patients who 
made the best adjustment showed a ten- 
dency towards the average rather than the 
extremes, both of which seem particularly 
pathological. Of importance, too, was that 
they found it necessary to combine two 



parameters in order to distinguish ade- 
quately among the groups which sug- 
gests an explanation for the frequent fail- 
ure of evaluations based on unidimen- 
sional aspects. 

I have deliberately limited my discus- 
sion to a number of general theoretical 
points in these three papers, each of which 
in its own way significantly advances re- 
search in this field. Consideration of the 
more detailed aspects of these studies 
seems to me more suitable for the small 
group meeting on this topic. 

In relation to the Butler paper, I raised 
several questions about the place and 
limits of the naturalistic approach in the 
study of the psychotherapy situation. In 
the case of Lennard, I considered particu- 
larly the problem of deutero-learning and 
its relationship to the kinds of learning 
which take place in psychotherapy. And 
with respect to Siegal and Rosen's paper, 
I examined further the use of inference in 
the psychodiagnostic situation. 
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DR. BUTLER: My first reaction is to 
thank Dr. Shakow for being so merciful 
to me and my colleagues, and the second 
is to say that I share misgivings he ex- 
pressed. I always feel queasy when I say 
things which implicitly set limits on any 
endeavor, and I am not at all sure that ex- 
perimentation as defined by logicians like 
Reichenbach, the verification of hypoth- 
eses through the use of experimental con- 
trols, is the only way of really knowing; 
at the moment it is the official way of 
really knowing scientifically, and in its 
own right it possesses, I think, consider- 
able dignity. I do feel some severe reser- 
vations about statistical methods. I refer 
to the discussions in Science a few years 
ago when some scientist said, "People 
doing ESP work are liars; we might as 
well face it." You perhaps recall that con- 
troversy. 

I think it was the physicist, Bridgman, 
who suggested that we abandon proba- 
bility as a criterion against which to meas- 
ure whether events really happened in a 
nonrandom or orderly way. In other 
words, if you throw the dice in one dis- 
tribution and the empirical distribution 
differs from the theoretical distribution, 
then you really have ESP. He pointed out 
that the difference between experimenta- 
tion as physical science understood it, and 
this sort of thing, is that in physical sci- 
ence you are pitting sets of events against 
other sets of events. I think there was 
something to his argument, and I think 
that perhaps statistics shouldn't quite have 
the prestige that they do have for us in 
evaluating experimental material. On the 
other hand, how can we get along without 
them? There I leave the matter. 



DR. LENNARD: There are two points 
which I would like to make. As you know, 
the deutero-learning idea in the paper 
submitted to this conference and in the 
research project upon which it is based 
was an afterthought and is still in the 
stage of an hypothesis. What we were able 
to document is a process of patient's 
socializations during therapy. Now, what 
kind of data would one like to have in 
order to get some bearing on the deutero- 
learning concept and to see whether or 
not learning in psychotherapy about the 
patient role helps in the learning of ex- 
pectations and how to respond to expecta- 
tions? The ideal data from our point of 
view would be to get data on patient- 
family interaction or patient-tester inter- 
action. Then we could see whether role 
learning in therapy facilitates role learn- 
ing in patient-family or patient-psycholo- 
gist interactions. Now, we don't have data 
of this kind, even though hopefully we 
shall one day. 

Let me also comment on Dr. Sanford's 
paper because it has some bearing on the 
kind of thing which we were trying to do 
in our study. I am concerned with the in- 
terrelationship of long-term outcomes 
which were discussed previously and 
short-term outcomes which cumulatively 
lead to the long-term outcomes. I have 
some difficulty in distinguishing the treat- 
ment variables which refer to short-term 
processes from patient variables which 
concern long-term changes in patient 
adaptation. Now, the problem seems to be 
that we have some measures of these long- 
term outcomes or approximation of meas- 
ures, but we don't have the vocabulary 
and the tools to come to grips with the 



9^9 



GROUP DISCUSSION: DEFINITION OF VARIABLES 



243 



short-term outcomes. By short-term out- 
comes I mean sequences in the therapist- 
patient interaction where there is a change 
in the patient or in the therapist. This is 
one of the areas where the kind of film 
data which Dr. Shakow has collected and 
where tape recordings of therapy can be 
very helpful. Repeated scrutiny of such 
data can help to identify and locate the 
points of transition in sequences of com- 
munication, both verbal and nonverbal. 

The problem is, of course, that it is a 
long step to relate act by act sequences in 
therapy to long-term personality changes 
conceptualized analytically. This is one 
area I would like your comment on how 
to make the transition. 

DR. SIEGAL: First, thank you, Dr. 
Shakow, for your sympathetic discussion 
of our problems and our methods. 

I would like to comment first on the 
term naturalistic, and here I think both in 
relation to Dr. Butler's paper and our 
paper, the questions arise, "What should 
one be naturalistic about? What is one 
being naturalistic about?" A generally un- 
recognized aspect of the Menninger proj- 
ect up to now I guess we have never 
stated it explicitly is that we try to ob- 
serve naturalistically not only the process 
of therapy but, in addition, we want to 
observe current clinical practice as it is 
carried on in our setting; that is, not only 
psychotherapy but psychodiagnosis and 
the concepts that we currently use. 

Our patient variables and treatment 
variables, for example, as Dr. Luborsky 
pointed out before, were not chosen solely 
on the basis of theoretical relevance but 
were chosen also because these are the 
concepts that the people we work with 
every day use in trying to assess suitability 
for psychotherapy, and so on. And what 
we have done in our paper is to let the use 
of the concepts speak for themselves. We 
did not start out to write a paper about 
anxiety tolerance. We looked over the test 
reports we had already written about our 



project patients and this is what jumped 
out at us. We could as well have written 
about something else, but this seemed to 
be a concept that was important in daily 
clinical work. In line with Dr. Butler's 
statements about naturalism, what we 
hoped for as a result of our examination 
of the concept was a somewhat more re- 
fined definition; not to try to prove any- 
thing about anxiety tolerance but just 
simply to refine the concept a little more. 

Dr. Shakow's caution not to "go over- 
board" on the subjective side is well taken 
and one with which I am in full agree- 
ment. I would only say that since it is also 
one of our aims to study the way clinicians 
naturally operate in using psychological 
tests, the way we naturally operate is to 
sit down with the tests, go over them and 
see what we think about them, and write 
down what we think rather than statis- 
tically comparing scores or group means 
or something more formal like that. I 
think that is all I would like to comment 
about. I don't know if Dr. Rosen would 
like to add something. 

DR. ROSEN: I, too, very much appre- 
ciated Dr. Shakow's comments and found 
them very helpful. I agree very strongly 
with his point about the importance of 
relevant variables, and in a sense I think 
our paper is a critique of one of the vari- 
ables that we had chosen for the project. 
We started with one notion of anxiety 
tolerance, examined it through the psycho- 
logical tests as it showed up in our pa- 
tients and as change in this variable mani- 
fested itself, and found that we then had 
to redefine the variable itself. In one sense, 
the whole of our project can be thought 
of as an attempt to sharpen and clarify 
our definition of the variables and really 
to see which ones are useful in assessing 
personality change. 

I agree, too, with the point about scores 
representing the same thing in different 
clinical contexts. In addition to studying 
intensively any one aspect of changed per- 
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sonality functioning, we also look at 
changes in each of our other variables, in 
defensive structure, in symptoms, in over- 
all personality organizations, and try to 
embed our thinking about any one aspect 
of change in a wider context. I think it 
would also be fruitful to discuss the point 
that was raised about the differences that 
might occur when one takes as the source 
of one's data psychological tests and when 
one takes as the source of one's data ma- 
terial directly from the therapy process 
itself, 

In our psychological testing we took an 
"independent" view of the patient, a cross- 
sectional view, describing his current per- 
sonality functioning in a way that is per- 
haps more difficult to do in the interview 
situation where one discusses with the pa- 
tient, for example, certain aspects of his 
treatment which by their very nature be- 
come historical (i.e., "How do you feel as 
compared with how you felt at Points X 
and Y back in time?"). 

DR. HUNT: These papers are open 
for discussion from the floor. Dr. Snyder. 

DR. SNYDER: I wanted to direct a 
question to Drs. Siegal and Rosen. I think 
maybe this is an extension of Dr. Shakow's 
question about the matter of subjectivity 
versus objectivity. Let me tell you that I 
am quite sympathetic with subjectivity, 
but I don't recall your discussing the re- 
liability and validity of the judgments 
that you reported. As I remember, when 
you classified the people, you said that 
something like six people fell in this class, 
and five people fell in that class. Do you 
have any way of saying how you can be 
sure not only that you are right about the 
numbers (which I think is not very im- 
portant, and which you weren't trying to 
say at this point) but even about the 
validity of the classes that existed? Did 
you check yourselves against each other in 
independent judgments, or did you just 
come to consensual agreement as you 
spoke about the thing with each other, 



and is this not a major problem and one 
which prevails in a lot of the things done 
in your research center? 

DR. SIEGAL: Yes, what is called for 
is a good solid reliability study, which we 
don't have the manpower to do, and which 
we didn't do. I think if we were able if 
we had been able to make these judgments 
independently we might have worked 
out a reliability study which I think would 
have a strong bearing on validity. 

DR. SNYDER: Well, let me say some- 
thing further that may seem harsh, and I 
don't want it to. At the last meeting I 
criticized Dr. Robbins and Dr. Waller- 
stein for the fact that you people con- 
sistently have refused to record therapy 
interviews, and I said that if you don't do 
so, you ignore the most essential data of 
the whole process. Now, I think you are 
saying to me that you can't check the 
validity of the measurements you make. 
Are these not damaging self-criticisms? 

DR. SIEGAL: What would you mean 
by validity in this instance? What did you 
have in mind? 

DR. SNYDER: Well, I mean that to be 
dealing with a science you must concern 
yourself with measurable data and you 
must have a yardstick which has grada- 
tions on it which can be related to the 
gradations of other people's yardsticks. 

DR. SIEGAL: Yes. I think what you 
are asking for is, quite properly, a new 
reliability study. 

DR. LEVINSON: Could you say why 
you could not do it? 

DR. SIEGAL: There are only two of 
us doing psychological tests for the proj- 
ect. We simply do not have time to double 
our work by each writing up the patient 
independently. Our data, you understand, 
were the reports which we had written. 
With another person an independent 
person perhaps we could have done it. 
Let me get to this point while this is 
true in our project about psychological 
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tests, it is not true about other aspects of 
it where we are able, with greater man- 
power, to have reliability studies and have 
reported some reliability coefficients. 

DR. GORHAM: Might it not still be 
possible to do something? If you have tests 
taken at different times, an independent 
judge could draw his own conclusions 
from the test data or from reports based 
on them. He could then decide whether 
or not he agreed with your findings. 

DR. SIEGAL: Certainly. 

DR. LUBORSKY: Are you agreeing 
that with time you hope to be able to get 
independent judgments on this variable, 
but it would require another person going 
over the psychological tests and going 
through the whole analysis just as you did, 
which means an equally great job to the 
one you have already done? 

DR. SIEGAL: Yes. 

DR. LUBORSKY: And the standard 
variables in our project have had relia- 
bility studies done on them. However, 
this anxiety tolerance variable in your 
paper was a new variable you added as a 
result of your new analyses? 

DR. SIEGAL: Or a redefinition of an 
old one. 

DR. SHAKOW: But you had certain 
criteria for what you call anxiety toler- 
ance? 

DR. SIEGAL: Yes, though not explicit, 
but subjective in a sense. 

DR. SHAKOW: If you were asked to 
make a list of those things, you could put 
them down; so that it is definable in some 
way. In discussing your paper, I was very 
glad to see some people sticking their 
necks out with regard to this issue: "We 
say that we used inference, not scores, as 
a basis for making judgments and evalua- 
tions." The reliability issue is quite sepa- 
rate, and relatively simple. You presum- 
ably have your criteria you agree on in 
your group. The problem then is: can two 
people take the same test data and draw 



their conclusions from these test data so 
as to come out with reasonably high cor- 
relations? Unless you tell me and this 
would be very interesting that only the 
tester can make these kinds of judgments. 
If that is true, then you really are in a 
tough spot. 

DR. SIEGAL: No, we certainly 
wouldn't say that. 

DR. SHAKOW: So that what Dr. 
Snyder is calling for is potentially pos- 
sible? 

DR. SIEGAL: Certainly. 

DR. ROSEN: I don't think Dr. Siegal 
or I want to be in a position in which we 
say (like, "the law is what the Supreme 
Court says it is"): anxiety tolerance is 
what Rosen and Siegal say it is. We did, 
however, use as our primary source of 
data the test reports which we had written 
as a regular part of the ongoing research 
project. In those reports we found that a 
major focus of our interest centered 
around changes in anxiety tolerance and 
in certain defensive constellations and 
patterns of personality functioning. It was 
from these data, from the test reports 
themselves, that we chose to build the 
paper. And on that level, "reliability" 
would simply involve agreement or dis- 
agreement as to what the test reports said. 
The question of the reliability of the re- 
ports themselves, of the inferences arrived 
at, is of course another matter, a task we 
see as still ahead of us. 

DR. BLOCH: Why are you backing 
away from making the inferences? It 
seems to me you are backing away from 
the accolade that was given to you. 

DR. LEVINSON: I would like to offer 
an additional argument for doing a relia- 
bility study. From a clinical point of view, 
you would have to go back to the proto- 
cols and write new reports. 

DR. ROSEN: Sure. 

DR. LEVINSON: I see several possible 
gains in doing this. One is that the criteria 
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would have to be made more explicit. Dr. 
Shakow has expressed an optimism that 
the authors could do this readily. We 
often discover, I think, that making ex- 
plicit the bases of our clinical inferences 
is quite difficult, and it would be useful 
to have this done. It would be a contribu- 
tion in itself. Second, I am willing to bet 
that the reliability wouldn't be too hot at 
first, even with two colleagues who know 
each other well and use the same words a 
lot together. One of the most constructive 
things for clinicians is to try to get relia- 
bility in our ratings on things we talk 
about every day. 

The attempt to make explicit our cri- 
teria and to teach them to someone else 
and discover the degree of interrater cor- 
relation would first yield great problems 
and then would lead to redefinition and 
further advance. You would get good re- 
liability, but also you would have new and 
more explicit definitions. This is one of 
the great needs in clinical studies. 

At this time we have two extremes: 
either people use test scores, about which 
we have great doubts as to validity, or 
they use clinical ratings without a very 
explicit definition of criteria, and without 
adequate reliability. If we could develop 
rating procedures involving high level in- 
ference but write out scoring manuals, 
and make explicit the criteria, and teach 
people to use them, I think we would 
make important gains toward operational- 
ising our concepts and also just saying 
what they are. 

DR. SHAKOW: I would like to re- 
iterate what Dr. Levinson has just said. I 
can think of few places where I would 
rather see this done than at the Men- 
ninger Clinic, the place that has had such 
a long tradition of using psychological 
tests in this clinical way. I think it is very 
important for the development of the field 
because we have generally evaded issues 
by falling back on the simplest devices, 



such as using literal scores. As you point 
out in your paper the scores can't be taken 
literally, that is, scores are not really 
equatable. Your method, as I interpreted 
it, would go in the direction of doing this 
and I would encourage its use. 

DR. SIEGAL: I couldn't agree more 
with both of those comments. I do think 
that those are precisely the things that we 
need to do. 

With at least some tangential bearing 
on the validity problem, I would like to 
hear some discussion on the convergence 
between Luborsky's results and ours, 
which, although they happen to be on the 
same patients, were done entirely inde- 
pendently. We didn't know anything of 
what he was doing and he didn't know 
what our paper was about. 

DR. BUTLER: I have a few thoughts 
about the Menninger reliability problem. 
One of them is that many of the reliability 
failures in clinical work are artifacts. 
Now, for example, let me mention our 
own work embodied in the paper we pre- 
sented here. We used a complex classifica- 
tion system, and we got people to work 
on the system, who were students inter- 
ested in the form of therapy we were 
doing and practicing. They were inter- 
ested in research, although one was a 
theological student, and, in particular, 
were interested in ideas that the principal 
investigators had. These people were just 
about as highly motivated as we were, and 
they had to be in order to work hard 
enough to put into it what we ourselves 
were putting into it. Now, if you ask one 
of your colleagues to evaluate these pa- 
tients the way you did, this might fall flat 
on its face because they are not interested 
in those cases, but if you were training 
some bright intern in psychology and you 
have a favorable influence or a special 
effect upon him, he may turn out to be the 
kind of person who could be motivated to 
think the way you do, or maybe he likes 
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your style of thinking, and then the train- 
ing could be gotten across I am speaking 
about Dr. Levinson's point. Under such 
circumstances, which have hardly ever 
been attained or even asked for, I suspect 
we'll get rather good reliability. We have 
this paradox: clinicians turn out to be sub- 
jective and unreliable, but the human or- 
ganism in general, apart from clinicians, 
is a sensitive, highly perceptive organism 
which is the best nonlinear computer that 
has yet been devised. It seems that the 
clinicians have been left out. I think with 
a little imagination this reliability prob- 
lem can be licked. Reliability has not been 
approached in a straightforward way. I 
think the motivational component is an 
important part of our problem. 

Going to another point, I want to bring 
out a research result of ours which seems 
to me to have some relevance for psycho- 
therapy research in general. When we 
factored our data, as Dr. Shakow says, we 
found a client factor, which we call a 
success factor, among other things, be- 
cause this kind of expression on the part 
of a client was associated with a rising 
ego strength on the Barron scale, a drop 
in anxiety as measured by the Taylor scale, 
success rating and other measures that Dr. 
Cartwright and Dr. Fiske are using in 
their project. The failure factor, the third 
factor listed, a particular kind of expres- 
siveness, tended to be associated with a 
relatively inexperienced therapist. We 
have done other studies using Q sort data 
and test results. Again we did a factor 
analysis. The experienced therapist had 
the clients who were in a success category 
and inexperienced ones got the ones in 
the failure category. It was an interesting 
exception that our most experienced 
therapists had failure clients and vice 
versa. This is going to be rather traumatic 
to a lot of therapists who lent themselves 
to be subjects, but I think that it means 
something we should face up to: (a) de- 



tailed description of what the therapist 
does, and () evaluation for purposes of 
research of how well he is doing it. 

Then, we look at another problem. The 
good therapist doesn't do well in certain 
cases, and the inexperienced therapists do 
very well with certain kinds of cases. 
Finally there are the kinds of cases in 
which both inexperienced and experienced 
therapists do equally well These are all 
embodied in our results. 

DR. SIEGAL: I think that is quite true, 
and our study is designed so that the vari- 
ous elements that go to make a therapy 
psychoanalytic or supportive or expressive 
or whatever, are separately rated. I think 
this is what you are asking for. To the 
extent that the judges do their job well we 
will have details about psychotherapy 
process. 

DR. COHEN: What Dr. Butler just 
said inspires me to make a comment. First, 
I would like to say something specifically 
about the failure factor in therapy and 
whether it correlates with our therapist 
doing a physical examination on a patient 
or such things. Dr. Butler's tone of voice 
convinced me that he felt that doing a 
physical examination on a patient by a 
therapist would be a large factor in the 
failure of therapy, and what I would like 
to say is that this would depend entirely 
on the cultural complex in which this be- 
havior occurred. For instance, in the 
Phipps Clinic, or Sheppard-Pratt where I 
was trained, the residents uniformly do 
physical examinations on their patients. 
They are the responsible physicians of the 
patients as well as their psychotherapists, 
and I know of many other contexts in 
which this kind of approach to therapy is 
neutral, so to speak, in respect to success 
or failure. There could be other contexts, 
of course, for instance, in a psychoanalytic 
institute where it would have enormous 
failure significance. 

On the whole, in our talk about therapy 
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it seems to me there is a tendency to slide 
over the question of the relevance of the 
variables we are studying. One important 
thing that seems to be neglected is the 
question of the matching between the 
therapist and patient Nobody would as- 
sume that the matching factor is insignifi- 
cant, and yet it has not been focused on 
very much for study in this particular col- 
lection of papers or in others. The concept 
I refer to is included in the words "we 
speak the same language" or "we click" 
or even more primitively, "the therapist 
likes the patient," or most sophisticatedly, 
"the therapist does not reach a level of 
anxiety which is beyond his optimum in 
dealing with this particular kind of pa- 
tient," or in a more general sense, "a 
therapist will succeed with certain kinds 
of patients regularly and fail with other 
kinds of patients regularly." It seems to 
me that this element is so relevant and is 
of such crucial importance that it ought 
always to be taken into account as one of 
the factors in every approach to the study 
of therapy. 

DR. FRANK: These last remarks re- 
mind me of what Dr. Butler said should 
be taken in conjunction with what Dr. 
Lennard was talking about what is a 
failure attitude and what is a success atti- 
tude will depend a great deal, as Dr. 
Cohen just said, on cultural aspects of the 
institution. The therapist who goes against 
the expectations of the center and the 
patient will probably get failure. In an- 
other center this very same failure might 
militate for success. 

DR. LENNARD: This is a very com- 
plicated matter and I will probably be 
sorry later that I raised the issue. How- 
ever, in relation to the point Dr. Shakow 
has made, I wonder whether therapy is 
really such a totally different social situa- 
tion from other problem-solving and in- 
teraction situations and how much and in 
what respects therapists differ from each 
other. Certainly, we use a different vo- 



cabulary to discuss psychotherapy than we 
do to discuss problem-solving interaction 
or family socialization processes, but does 
that necessarily mean that we are really 
dealing with radically different processes? 
There are parallels in the kinds of inter- 
action patterns occurring in psychotherapy 
with those occurring in problem-solving 
groups. Also, much has been written, espe- 
cially by the analysts regarding similarity 
of the family situation to the psycho- 
therapy interaction. But, over and above 
specific similarities, there are a number of 
concepts which have applicability to social 
systems per se, and psychotherapy consti- 
tutes one system of this kind. 

DR. SHAKOW: I made both state- 
ments in my discussion. I talked about the 
peculiar character of the psychotherapy 
situation. I think the reason I separated 
the different kinds of learning that take 
place in the psychotherapy situation was 
to counteract a tendency nowadays to 
equate the psychotherapy situation too 
much to the social situation. I think we 
must recognize not only the similarities 
between psychotherapy situations and other 
dyadic situations but also the dissimilari- 
ties. It has now become popular to talk 
about the dyadic situation of therapy as if 
it were an ordinary social relationship 
between two people who meet in a rail- 
road car or two people two friends 
who meet for an evening. I think one 
must recognize that although there are 
similar features, there are also many fea- 
tures that are different. Different forms of 
therapy have similarities and differences 
to varying degrees. I think the psycho- 
analytic situation represents the extreme 
difference from the social. It is really so 
different that I doubt the legitimacy of 
just calling it another kind of social situa- 
tion. In doing so, too many things get lost 
if we do. I think we ought to think about 
what things are common. Again, as I saw 
it, I would raise a question about deutero- 
learning application. There is a narrow 
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socialization process in the psychotherapy 
situation which has to do with each learn- 
ing his own and the other's role. This is 
the game aspect of therapy. But aside 
from this, there are other levels of learn- 
ings which go on besides this role learn- 
ing. These have to do with the quite dif- 
ferent symbolic qualities in the relation- 
ship which are not as literal and as direct 
as the role aspects. 

DR. LENNARD: Certainly, I don't 
underestimate the differences, but if I may 
offer a hypothesis regarding Dr. Butler's 
comments, it seems that the more experi- 
enced therapists have given up the excess 
ideological baggage, and that they are re- 
sponding more to the "here" and to the 
"now" of the therapeutic system. "System 
sensitivity" may be a function of experi- 
ence. 

DR. MAHL: First I have a question to 
ask Drs. Luborsky and Rosen. You two 
keep saying that your studies support each 
other. I thought your study, Dr. Luborsky, 
showed that there was a correlation be- 
tween the initial level of anxiety and the 
amount of change in the health sickness 
ratio. I thought your study, Dr. Rosen, 
showed that you could make inferences as 
to the change from pretest to posttest 
anxiety tolerance. I don't understand 
where your two studies deal with the same 
thing. Could you give me an answer on 
that? 

DR. SIEGAL: In Dr. Luborsky's study, 
for those people who scored low to start 
with, on the health-sickness rating scale, 
the correlation between level of anxiety 
and the amount of change or amount of 
improvement was much lower I don't 
remember the exact figure than for those 
people who initially scored high; the 
point being the same point we tried to 
make in our paper, that anxiety means 
different things in different people. In a 
patient who is pretty healthy to start with, 
I think most people would agree that 
anxiety may be good motivation. On the 



other hand, if a patient is not very healthy 
to start with, his anxiety has different im- 
plications. That is the convergence that 
we are talking about. 

DR. MAHL: I see. 

DR. LUBORSKY: So we could use the 
label "anxiety tolerance" in a sense for 
one aspect of my data as well, and there- 
fore on that point there is a convergence. 

DR. MAHL: Most of the discussion 
about Drs. Siegal and Rosen's paper 
focused on the reliability with which the 
classifications could be made. I agree with 
everybody else that the determination of 
this reliability would be highly desirable. 
Not much was said about the validity of 
these classifications, which is more im- 
portant than their reliability. In this con- 
nection, I believe there is a logical prob- 
lem involved. As I understand your defi- 
nition of the concepts, autoplastic and 
alloplastic, you are dealing with auto- 
plastic material when you classify projec- 
tive test responses. You make inferences, 
however, about both autoplastic and allo- 
plastic processes which, it seems to me, 
create a high order logical problem. At 
least I dislike the semantics of your use 
of the terms "autoplastic' 3 and "attoplas- 
tic," It seems to me quite different from 
Freud's meaning when he introduced 
them. In his thinking, autoplastic referred 
to a change inside a person, immediate 
discharge over internal paths, and was a 
characteristic of primary process activity. 
Alloplastic referred to behavior detoured 
through the environment in order to 
bring about the desired gratification and 
was of a higher developmental level, char- 
acterized by delay and the other features 
of secondary process activity. I have these 
meanings in mind when I read your paper 
and am confused by your concepts. 

DR. SIEGAL: We are aware that there 
is a difference between the way we used 
it and the way it was originally used. 
What we were trying to do again, to use 
the term "naturalistic" we were trying 
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to use the terms the way they are general- 
ly used in our setting. 

DR. LUBORSKY: In other words, you 
are saying it isn't the definition that Dr. 
Mahl just gave. It just refers to the pa- 
tient's tendency to respond by trying to 
change things outside of himself rather 
than within himself. Is that it? 

DR. SIEGAL: Yes, that is all. 

DR. MAHL: I would like to pose some 
further questions. The anxiety tolerance 
variable, I think we all agree, is a crucial 
one in therapy. It would be very helpful 
to have a discussion, when there is time, 
as to how anxiety tolerance shows up in 
therapy hours. So far the referents have 
been test material. I think that in good 
studies of psychotherapy we must devise 
ways of assessing anxiety tolerance during 
therapy interviews themselves. In this 
connection, I have wondered if anxiety 
tolerance is related to Dr. Butler's Factor 
I. It could be. Your Factor I, Dr. Butler, 
is a global factor, isn't it mere expres- 
siveness, without specification of the affect 
being expressed? 

DR. BUTLER: It specifies in a way. It 
can be specified in terms of the classifica- 
tion system. 

DR. MAHL: But your classification 
doesn't distinguish between an expression 
of anger or anxiety? 

DR. BUTLER: No. 

DR. MAHL: I think it would be very 
important to push your approach further 
so that anxiety would be one of the things 
assessed. Also, I have wondered how the 
appearance of anxiety tolerance in inter- 
views is rekted to socialization. Have you 
made any observations on this, Dr. Len- 
nard? Does the capacity to tolerate some 
anxiety, the capacity to tolerate the ma- 
terial that provokes the anxiety signals, 
start to become manifest after this social- 
ization process in therapy has taken place 
to a certain degree? When the patient 
(or therapist) cannot tolerate anxiety, is 



there a reversion to talk about the social- 
ization process? Or is there no relation- 
ship between the two? These are some 
of the things I would like to hear dis- 
cussed. 

DR. LUBORSKY: I would like to ex- 
press my agreement with the importance 
of taking this newly defined concept of 
"anxiety tolerance," which is based on 
psychological testing, and pointing it 
directly to the treatment; I believe we 
will find out some useful things that way. 
An investigation ought to be set up to 
see the way in which high levels (as com- 
pared to low levels) of anxiety in a par- 
ticular hour go with the kinds of changes 
that take place in that therapy hour. The 
study could be done both for patients 
with high and low anxiety tolerance. It 
would be a feasible investigation with the 
research tools that are already available. 

DR. HUNT: You would put some 
palmar conductance into this? 

DR. LUBORSKY: Yes, that is a good 
idea. But at first one should try to get 
observers to make these judgments direct- 
ly, both of anxiety level and tolerance. 
You could record the material and use Dr. 
Butler's method for classifying the re- 
sponses of the patient and therapist, illus- 
trated in his paper. 

DR. HUNT: I am going to ring the 
curtain down on this topic, and give Dr. 
Bordin and Dr. Sanford a chance to come 
in. 

DR. BORDIN: This dialogue between 
Dr. Shakow and Dr. Lennard, to my view, 
fitted in with the whole timely thought. 
In fact, I was accumulating some natural- 
istic observations about a number of proc- 
esses here, and it culminated in a thought 
that one central issue may be emerging. 
It might be fruitful to pose this issue to 
either one group or to all of the groups. 
I am inclined in the latter direction be- 
cause I am not sure that our category sys- 
tem for setting up the groups permitted 
a meaningful choice of group. I see 
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emerging a strategic question, and I think 
it has more than a strategic implication, 
namely, "When does simplification ac- 
quire certain additional characteristics 
that lead us to use the prefix overt" It 
seems to me that this is one way of posing 
one of the recurring questions that sur- 
round the whole issue of "What is the 
best way to proceed?" We were talking 
about it in connection with Dr. Krasner's 
paper. That is, what are the criteria that 
must be satisfied to make simplifications 
that permit extratherapeutic studies of 
therapeutic issues acceptable? This is an 
important question to me because I have 
been involved in both thetapeutic and 
extratherapeutic studies. I know that Dr. 
Colby and others are involved in it, and T 
think that it would be a disservice to stop 
at the point of simply expressing skepti- 
cism. These smaller groups offer the op- 
portunity to get to a deeper level of con- 
sideration of the question. What assump- 
tions are we making either in terms of 
theory or in terms of our personal obser- 
vations that are leading us to say this 
particular simplification is "over"? We 
must begin talking in these terms to each 
other to get down to the bedrock of either 
assumption or observation that leads us to 
reject what each of us in our research has 
to say to each other. I have a faith that 
when a group does this, with curiosity 
being one of the major motivations, that 
this dialectic can lead to the clarification 
of what are the kinds of research that can 
have the maximum to say to each other. 
The "each other" in this instance are those 
who are conceptualizing their data, choos- 
ing their variables in different terms. Dur- 
ing the break Dr. Shakow was talking 
about the problem he has of reading cer- 
tain kinds of papers that go outside of his 
frame of reference. This ought not to be 
happening. Increasingly, our papers ought 
to establish contact between frames of 
reference so we can decide which trip is 
really necessary. 
DR. SANFORD: I had an impulse to 



speak when Dr. Shakow said, "Yes, of 
course, there are some similarities be- 
tween psychoanalysis and other sorts of 
social interaction." There are some differ- 
ences, too. And my impulse was to say, 
well, what are the differences? I am not 
proposing that he undertake to answer 
now, but this does seem to me to be just 
the question that we ought to be asking. 
You see I am coming back to my scheme 
introduced earlier, and I have been en- 
couraged by the feeling that I had an ally 
in Dr. Lennard. I think what we would 
favor would be a set of terms that would 
enable us to describe the differences as 
well as the similarities between one kind 
of psychotherapy and another, or psycho- 
therapy and other kinds of interpersonal 
situations that have some impact upon the 
individual. If we undertake these descrip- 
tions, we will find ourselves discussing 
what kinds of things do influence people 
and in what ways, or what kinds of activi- 
ties engaged in by the psychotherapists, 
or by other professionals who use verbal 
means for influencing people, affect indi- 
viduals having different kinds of char- 
acteristics. I think it is very instructive, 
for example, to compare psychoanalysis 
and brainwashing, as we started to do this 
morning. Your group ought to discuss 
this kind of question in the next session, 
it seems to me. It doesn't make any dif- 
ference whether the accent is on similarity 
or on difference. Such discussion will 
ckrify and perhaps highlight some of the 
interactions that presumably influence the 
patient in some desired or predictable 
way. 

DR. BUTLER: I have two comments 
to make. One is with respect to yours, 
Dr. Sanford. It seems to me there has 
been some research which shows that 
there are more similarities between, for 
example, experienced therapists of dif- 
ferent orientations, than between experi- 
enced and inexperienced of the same 
orientations. On the other hand, as I 
have listened to recordings of Adlerians, 
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Rogerians, Freudians, and so on, I have 
noticed that there are really distinctive 
differences. I think in this area of re- 
search we haven't achieved the useful dis- 
tinction made by the factor analyst be- 
tween common variance and unique vari- 
ance what is common to all of us as 
therapists and what is unique? Possibly 
both of those have their own share in 
producing distinctive patterns of outcome. 

The second comment is a delayed reac- 
tion to something you said, Dr. Shakow, 
about the relationship between natural- 
istic observations and experimentation. I 
think that one of our problems is that 
the therapy situation really is a natural 
situation, like Darwin's island. Therapy 
can go on and does go on and has gone on 
without research. As we begin to inter- 
vene in this process we intervene in a 
known and in an unknown way. One way 
which has not been considered too much 
is interaction between the tests and the 
therapy. I think we have difficulties even 
in getting to semiexperimentation as 
shown by the difficulty Dr. Snyder had 
when he had the same therapists trying to 
do two types of therapy. Therapists do 
have preferences. If we develop out of 
our own situation as a research strategy 
new ideas about therapy from all kinds 
of observations, naturalistic and other- 
wise, it seems to me that one research 
strategy, for example, is to convince your- 
self that change in your own therapy is 
desirable. Then one can go back and look 
for hours which might exemplify this, the 
things that led you to the new conclu- 
sions. Second, one can try them out in 
isolated hours in therapy. As a matter of 
fact this is just what we are doing. We 
have come to some new ideas as a result 
of our work. We have taken particular 
hours in therapy and have gone along as 
usual and then introduced this new be- 
havior thinking it will not have too much 
effect on the total therapeutic process. 
We try this thing as an isolated hour in 
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the therapy and try to observe the changes 
in the structure of the therapeutic hour 
at that point. The control against that is 
the previous therapy and possibly the pre- 
vious hours so that I think what we are 
doing is following your maxim which is, 
as I understand it, "Don't make too much 
distinction between the experimental and 
naturalistic methods." I emphasize how- 
ever, changing ourselves as therapists in- 
stead of going to therapists and saying 
"You must change for the benefit of our 
research." That is not only threatening, 
but in a sense it is destructive of the par- 
ticular situation we are interested in. 

DR. STRUPP: I'd like to refer to Dr. 
Butler's comment about the common and 
unique variance. I think a great many 
efforts are being made these days to tease 
out the "common variance" in different 
approaches of psychotherapy, brainwash- 
ing, child rearing, and so on. Dr. Frank 
in his recent book, 1 for example, is trying 
to spell out the common elements in psy- 
chotherapy. Perhaps you will agree that 
one of the things we are trying to do as 
researchers is to isolate the common as 
well as the unique elements in the psy- 
chotherapeutic enterprise. If we could 
do this, we would presumably become 
more effective as psychotherapists. This is 
what I have tried to say in different places 
when I distinguished between the per- 
sonal and the technical contribution of 
the therapist. It seems to me that psycho- 
therapy will become more effective inso- 
far as we are able to become more specific 
about the personal as well as the technical 
aspects. It may well be that technique 
maximizes the therapist's personal at- 
tributes and/or other common underlying 
elements in the process. I hope that our 
small group discussions might address 
themselves to this problem. 

DR. BLOCH: It is getting very late 
and maybe this should be the last time 

1 Frank, J. D. Persuasion and healing, Balti- 
more: Johns Hopkins Press, 1961. 
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the word "naturalistic" is used this after- 
noon, but I would like to speak for one 
kind of relationship to the material which 
hasn't been mentioned at all. My work is 
with children, and in doing process-out- 
come studies there, we have an oppor- 
tunity to make direct naturalistic observa- 
tions of the child's functioning, either in 
the home or in the school, or in his total 
life situation. Now, all of us would cer- 
tainly agree that the ultimate test in 
therapy is a change in the life situation or 
life functioning in some way, unspecifi- 
able perhaps, of the patient. Yet it is 
very rare that we ever have direct contact 
with that. At best we have some assess- 
ment of functioning in the therapeutic 
situation and we generalize from certain 
variables there ego strength, insight, 
and what have you to the real world. 
While it is certainly easier to observe 
children in their natural habitat, it doesn't 
seem to me impossible to do even with 
adults. 

I want to speak of the necessity to keep 
in mind the total life of the patient, to 
turn one's thoughts ultimately back to the 
issue of his real daily interactions, his 
hopes, his fears, his joys, just on that level 
of abstraction. 

DR. KRASNER: I hate to bring up 
naturalistic observations again, but I must 
balk at the analogy of naturalistic obser- 
vations of the process of psychotherapy 
with Darwin's naturalistic observations. 
I think there is far too strong an implica- 
tion of psychotherapy as being a "natural" 
process upon which we work from a re- 
spectful distance so as not to distort it. 
Psychotherapy is not an inherent natural 
process, but rather a highly artificial, even 
an experimental, laboratory situation. As 
just one example of this, the behavior of 
the therapist is a function of his train- 
ing. Different training produces different 
therapist behavior. This is not nature's 
process. Darwin observed a process that 
took thousands of generations to develop. 



The kind of psychotherapy we are talking 
about is a very recent innovation created 
and manipulated by man. 

Still reacting to the word naturalistic, I 
would like to call attention to a fascinat- 
ing and humorous paper which some of 
my colleagues may have read, by Jay 
Haley, called "The Art of Psychoanalysis." 
It is a semiserious interpretation of psy- 
chotherapy as an "upmanship" relation- 
ship. Both the therapist and the patient 
try to get "one up" on each other. Some- 
how these and similar views influence my 
nonnaturalistic conception of psycho- 
therapy. 

DR. LENNARD- My comment also 
refers to the issue of naturalistic observa- 
tion. Now, one of the many problems 
here is deciding on units of behavior to 
be observed and methods of observation 
to be employed. What does one do, as an 
observer, about processes which proceed 
at a different tempo or move on a dif- 
ferent level than we are used to keeping 
track of? For example, some sequences 
may occur within seconds, while other 
characteristic patterns may evolve only 
over a number of sessions. In the latter 
instance it may be most difficult, on the 
basis of on-the-spot observation, to ac- 
count for complex interrelationships. An 
analogy may help to clarify this thought. 
While it is not fully possible to specify 
the effects of particular drugs, investi- 
gators do have some notions about the 
time intervals within which to look for 
these effects. In the case of some drugs it 
is not likely that the organism will process 
them for more than a day; in the case of 
others some physical processing may occur 
for a week or ten days. 

But what guidelines do we have in de- 
termining the time interval within which 
to search for the effect of a particular 
therapist input to the patient? For how 
long is a comment, an interpretation, a 
feeling processed by the patient? For 
how long is it utilized, if at all? I think 
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Dr. Colby referred to this earlier when 
he spoke of stochastic processes. But this 
general concept does not help us to define 
the intervals involved. 

DR. LEVINSON: Dr. Bloch pointed 
out that we have tended to focus very nar- 
rowly on what happens within the therapy 
situation or inside the patient or the ther- 
apist. I hope that this is something the 
committee discussing personality change 
will consider. My impression is that we 
have talked about personality change 
largely as it is assessed by means of diag- 
nostic tests or therapist's ratings how 
the patient looks to him at the end of the 
treatment as compared with the begin- 
ning of treatment. Very often the ther- 
apist will say, "The treatment was very 
successful. The patient and I now have a 
very good relationship." This may or may 
not have anything to do with how the 
patient is living. 

I assume that in naming one of the 
sections, the assessment of personality 
changes, the planning committee had in 
mind the study of outcome, that is, what 
has been the impact of the psychothera- 
peutic experience on the patient? If we 
are going to assess this adequately, then 
we have to go far beyond what is happen- 
ing between the patient and the therapist. 
"We have to look at how the patient is 
living. Here we have, I think, a great 
need for observational studies. We ought 
to expand the horizon of the researcher, 
and in the process we might also expand 
the horizon of the therapist. We usually 
know very little in a direct way about how 
the patient lives, and I think that in study- 
ing this we would also get to some of the 
questions that Dr. Bordin has raised in 
what sense is therapy like other situations, 
in what sense is the role of therapist simi- 
lar to or diff erent from the roles of others 
in the life of a patient or of other people? 
Psychotherapy has tended to be a quite 
provincial kind of professional role, by 
and large. Psychotherapists have stayed 
very much within the office for what they 
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could learn about people. If psychother- 
apists were to know more about how their 
patients were living just before therapy 
started and how they are living when 
therapy is over, they would probably also 
learn how to be better psychotherapists. 

DR. BLOCH: This amplification is 
very pleasing to me and I would like to 
carry it one step along. I believe this is 
the line of thought which ought to gen- 
erate the variables, and the behavioral 
patterns we choose to measure them. It 
helps us with some serious problems: it 
guards us against triviality, and it guards 
us against irrelevance. It doesn't make 
research easier, but I think the ways in 
which it makes it difficult may be man- 
ageable. As Dr. Strupp noted, our ener- 
gies are really quite limited. I would hope 
we would rather be wrong than trivial. 

DR. HUNT: The chair would like to 
underline a couple of points in the hopes 
of producing some Zeigarnik-uncom- 
pleted-task effects for tomorrow. I should 
like to say that I wish someone had picked 
up Dr. Cohen's point about the problem 
of the match between the personality of 
the therapist and the personality of the 
patient. I like the idea of thinking about 
the therapeutic relationship as being not 
unlike the marriage relationship (even 
though the therapeutic relationship is 
hopefully much more temporary) . In this 
sense, there are presumably personalities 
that can enter into a fruitful therapeutic 
relationship, and there are presumably 
other kinds of personalities that cannot. 
While I was studying the caseworker- 
client relationship at the Institute of Wel- 
fare Research in the Community Service 
Society of New York, I used to say this 
sort of thing. It was usually taken as 
heresy. For this reason, I have been very 
much interested in Dr. Cohen's making 
this same point. I believe the relationship 
of personality variables in the client and 
in the psychotherapist are probably very 
important for the psychotherapeutic re- 
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lationship. In our research at the Univer- 
sity of Illinois, we have tried to touch 
upon them, but we have not been very 
successful. 

Secondly, I should like to underline 
what Dr. Bloch has been saying about the 
importance of obtaining criteria for the 
results of psychotherapy from outside the 
therapeutic hour and from outside the 
therapeutic situation. Fascinating stories 



exist about the contrast between the na- 
ture of clients and of their interpersonal 
behavior as gleaned in the psychothera- 
peutic situation and as observed outside 
the therapeutic situation. Sometimes the 
two pictures of clients can be profoundly 
different. This fact challenges our attribu- 
tion of complete validity to our observa- 
tions of clients or patients within the 
therapeutic situation. 



SUMMARY REPORTS OF PANEL DISCUSSIONS ON 
RESEARCH IN PSYCHOTHERAPY 1 



Summary Report: Therapist's Contribution (A) 
MORRIS B. PARLOFF, PH.D. 



Perhaps some of you will remember a 
study published a few years ago which 
purported to show that given a choice, 
people preferred familiar concepts to un- 
familiar concepts and familiar ideas to 
unfamiliar ideas. It occurs to me that at 
this hour and at this stage of the confer- 
ence, what I am about to report to you 
should, on this basis, be all too congenial. 

Dr. Snyder and I, in looking over our 
notes, found that a reasonable way of 
dividing up the material for these reports 
was for one of us to take the morning 
session and the other the afternoon ses- 
sion, as they were, in fact, quite different. 
I have chosen to report on the morning 
conference. 

In the morning session we appeared to 
be concerned with building up a model of 
sufficient complexity and scope to satisfy 
our group. In retrospect, the morning ses- 
sion may be characterized as the "it's 
really more complicated than that" ap- 
proach, while the afternoon appears to 
have been devoted to assuring ourselves 
that "it's really simpler than that/' 

I believe that the morning activities of 

1 Verbatim transcripts of the three panel dis- 
cussions on the second day of the conference 
are not included. The day's discussion by each 
of the three groups makes a huge amount of 
prose, and we are in the fortunate position of 
having excellent summaries in the reporters' 
reviews. 



our group may be viewed as having 
passed through three stages: (a) seeking 
to achieve completeness, (&) practical 
application or reality testing, and (c) 
data and problem reduction. 

During the first stage of the morning 
session, we were preoccupied with the 
aim of achieving a general definition of 
our mission. This took the form of ex- 
panding the mission. It was not enough, 
for example, to limit ourselves to an in- 
quiry into the therapist's influence on the 
treatment process. Instead, we believed it 
was necessary that we also discuss the 
therapist's relationship to outcome. For- 
tunately, Dr. Levinson was able to pro- 
vide us with a ready model based on his 
paper. He suggested seven areas or do- 
mains around which we could focus our 
discussion: (1) the therapist's personality 
and social characteristics; (2) the pa- 
tient's personality and social character- 
istics; (3) the interactions between (1) 
and (2); (4) the stages of therapy; (5) 
outcome; (6) the institutional setting; 
and (7) the patient's social setting. 

It was then suggested that even this 
was not complete enough because the 
therapist's personality could not be de- 
scribed as a fixed quantum but rather 
varied in terms of the therapist's interac- 
tion with and reaction to his patients. We 
would have to take into account the fact 
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that the patient would evoke different 
aspects of the therapist's personality and, 
of course, the therapist would in turn 
stimulate different aspects of the patient's 
personality. 

Another complication to be considered 
was the observation that it was not suffi- 
cient for our purposes "merely" to de- 
scribe the therapist's behavior during 
therapy. What we would really like to 
have would be a record of the therapist's 
thoughts and emotions as he was in the 
actual process of conducting therapy. Cur- 
rently we have available only his pallid 
and tidied-up postinterview reconstruc- 
tion of them. 

It was at about this point that we 
moved into the second stage of the meet- 
ing: practical application or reality test- 
ing. This transition occurred with a state- 
ment by Dr. Bolgar and an all-too-practical 
question asked by Dr. Cohen. Dr. Bolgar 
described a study in which attempts had 
been made to obtain data regarding the 
therapist's thoughts during the treatment 
session. Thus not only was the therapist 
being asked to provide a "free" report 
and a "structured" report subsequent to 
each treatment session, but during the 
course of therapy was required to indicate 
his feelings as he became aware of them 
by manipulating a keyboard. Each of the 
five keys represented an affective experi- 
ence of the therapist. There was a sincere 
attempt to get these data, but the point 
of Dr. Bolgar 7 s report was that it appeared 
extremely difficult for a therapist to at- 
tend to the patient, to the therapeutic 
intervention, to his own feelings, and to 
the experimental requirements. It was so 
difficult, in fact, that finally the therapist 
gave up the use of the keyboard. 

Dr. Cohen then raised the sobering 
question of how docs one go about an- 
alyzing a mound of data such as that 
which has been accumulated at the Na- 
tional Institute of Mental Health. Sound 
films of some five hundred psychoanalytic 



therapy sessions were available to her, but 
how was she to go about analyzing that 
amount of data in order to investigate 
such problems as the therapist's role and 
the "therapeutic process"? In responding 
to Dr. Cohen's question, the group moved 
into the third phase: data, variables, and 
problem reduction. 

One suggestion for dealing with the 
problem of data reduction was to aban- 
don the idea of analyzing the 500 hours 
in any detail, but instead to derive hy- 
potheses from these data which could 
then be tested by simulating various con- 
ditions, variables, and responses on a 
computer. Thus a computer would be 
programed in such a manner as to test 
out the hypotheses with rationally derived 
rather than empirically determined data. 

Another suggestion was that one need 
but code the specific interventions with 
which he was concerned and then feed 
those to the computer. This left open the 
question of how one identifies the subtle 
and highly inferential states with which 
the investigator deals. The data on which 
an inference may be based must first be 
identified in order that it may be coded 
and analyzed in a high speed computer. It 
was agreed that although machines could 
process data more quickly, machines could 
not as yet make the necessary inferences 
for us. In psychotherapy one does not 
usually deal only with overt behavior 
which permits ready identification and 
coding but, instead, we are concerned also 
with some rather high level inferences. 
These inferences can be drawn at various 
levels of abstraction. 

The group was reassured by some that 
perhaps this was not such an insurmount- 
able task as it had been made to sound. 
There probably are, in fact, only a "small" 
number of variables which have to be 
considered. In the further discussion of 
the term "small," it was found to mean 
"little" in the same sense that "finite" is 
small as contrasted to "infinite." Since it 
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was generally agreed that in all likelihood 
a relatively small number of variables 
contributed significantly to the variance 
of any given research problem, it would 
be wise to identify these variables. 

The emphasis then shifted to a con- 
sideration of the strategies which might 
help investigators to identify these rela- 
tively few important variables. Two tech- 
niques were discussed briefly: one was 
modeled after the "approximation tech- 
nique." One could begin his research with 
rather broad "coarse-grained" variables 
and by successive approximation attempts 
to test out predictions. On the basis of 
the results, one could then refine the vari- 
ables and improve his next prediction. 
The other technique appeared to be the 
opposite of the first in that it required 
one to adopt a very meticulous micro- 
scopic approach to the data in the hope 
that the investigator might thereby build 
up a conceptual mass sufficient to enable 
him to derive significant inferences. The 
question was raised, however, of whether 
the fact of restricting the analyses to a 
given type of data coarse or fine grained 
would restrict the researcher to one or 
another level of abstraction. 



Still another suggestion for identifying 
important variables was to manipulate 
the situation in new ways in order that we 
might increase the chances of seeing new 
consequences. It was argued that if we 
persist in following the classical research 
techniques and continue to ask the same 
questions, then we must cherish the 
megalomaniacal hope that somehow we 
will be luckier or brighter than all of 
those who have preceded us along these 
same avenues. The formulation of new 
questions and the use of new research 
techniques would probably increase the 
likelihood of our success. 

With the discussion of data reduction 
techniques came the suggestion that per- 
haps we could profitably reduce the ques- 
tion with which the group was concerned. 
It was agreed that it might be wise to 
focus on something less than the broad 
issue of the therapist's role in therapy. We 
might instead select a small question and 
get down to dealing with some data 
which would help document and thereby 
further the discussion. It was decided, 
therefore, that in the afternoon session 
attempts would be made to specify a ques- 
tion and bring relevant evidence to bear. 



Summary Report: Therapist's Contribution (B) 
WILLIAM U. SNYDER, PH.D. 



I am a bit more uncertain than Dr. Par- 
loff is about the effectiveness of our group 
meetings. I have had some images about 
the group. Perhaps because we were meet- 
ing on the top floor of the planetarium I 
tended to see our group as a lot of inde- 
pendent stars moving in unrelated orbits. 
The stars seemed to be moving in sepa- 
rate orbits, but I think that I, for one, 
perceived that there were two galaxies, or 
maybe three. One galaxy was that of the 
people who were natural observers far 
excellence, and as Dr. Parloff" has said, 
people who tended to want to collect very 
large masses of data, perhaps from small 
groups of patients or subjects, and then 
see what they could do about it. The sec- 
ond galaxy consisted of those people who 
tended to be more along the line of theo- 
retically oriented observers, who felt that 
you have to start with a plan in data col- 
lection. They seek the origins of a prob- 
lem, plan the data collection, set up the 
variables, and measure only certain vari- 
ables in a carefully defined way. In this 
second galaxy, or perhaps as a third 
galaxy, there was one very bright star 
which traveled in completely independent 
orbit. I am speaking about Dr. Krasner. 
He wanted to take the thing out of the 
life situation entirely and throw it into 
the lab and study some microproblems 
about the behavior, and, in fact, maybe to 
forget about therapy altogether and just 
study change in behavior, or something of 
that sort. 

Well, we attempted to go ahead with 
discussing some more specific studies, and 
I will run through a few of these quickly. 
First, there were about six attempts to 
find out what kinds of studies we should 
talk about, and we finally settled on one: 



studies relating to the question of what 
factors affect the selection of patients in 
therapy, i.e., what are the patient charac- 
teristics which determine selection. Dr. 
Levinson reported a study his group had 
carried out, in which residents were al- 
lowed to choose their own patients. There 
were some questions raised as to why 
residents chose certain patients versus 
others, and what were the characteristics 
of those patients who were chosen. An 
attempt was made to see whether they 
could be differentiated by means of diag- 
nosis, but this proved unfeasible (and I 
might note that this only shows what an 
inadequate thing diagnosis is). Anyway, 
the things that did seem to differentiate 
the patients chosen by the residents for 
treatment were their age (they were 
younger), their socioeconomic class (they 
came from a higher socioeconomic level), 
their tendency toward authoritarianism 
(it was lower), their conception of the 
hospital, and their orientation toward 
treatment. Some scales were made up to 
test this. The patients who got therapy 
seemed to be those who wanted it and 
for whom it was somewhat meaningful. 
It was observed that the residents were 
more similar to the patients they selected 
than they were to the patients that they 
did not select. Some attempts were made 
to explore whether this selection is 
rational or irrational. It was demonstrated 
that patients who were high on the F 
scale would not be as accepting of ther- 
apy because, Dr. Levinson felt, they were 
anti-introceptive. However, one member 
of the group questioned the point and 
suggested that high F-score patients may 
actually be good therapy cases in certain 
types of therapy because they tend to be 
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compliant persons. They are accessible to 
therapy because of their characteristic 
compliance. 

It was asked, ''What is the uniqueness 
that makes the therapist choose the pa- 
tient?" These characteristics, as Dr. Levin- 
son has pointed out, are the characteristics 
that often go with our personal associa- 
tions in life. Patient and therapist must 
have something in common. Is selection 
based on anything that has validity, or is 
it simply some sort of cultural stereotype? 
And to what extent do the therapist's atti- 
tude and personality influence the kind of 
treatment the therapist engages in? 

At this point we got into a discussion 
of the question of clinical intuition and 
the feelings that the clinician has that 
he can detect, very early in therapy, those 
cases with which he will be able to work 
and those with which he will not, and 
the words "matching" and "clicking" 
were used. But this idea was challenged. 
I believe Dr. Colby was one of the 
stronger advocates of this challenge, but 
it was challenged by other people, includ- 
ing Dr. Bolgar, who said that she has evi- 
dence which clearly demonstrates that 
therapists can work successfully with 
patients with whom they do not "click." 
The point was raised by Dr. Parloff" that 
if in research one follows the idea that 
one can only work with patients with 
whom he "clicks," this is a self-fulfilling 
proposition. The therapist who says "I 
can't work with this man" and then can't 
work with him, cannot be subjected to 
research. 

Dr. Bernstein reported a pilot study of 
an attempt to combine therapist's per- 
sonality with techniques, and this seems 
to be a rather important idea that has per- 
vaded the literature frequently of late. 
He said that, using sound-film recordings, 
his group was able to predict the content 
at the end of the interview, whether the 
patient would stay in therapy, and some- 
times perhaps the outcome, but he was a 
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little dubious about that point. He also 
reported some case material suggesting 
his concerns about what happens to the 
patient's chief complaint. It seems to dis- 
appear during therapy, and he wondered 
whether the patient has been talked out 
of his chief complaint and into something 
else. This brought up Dr. Frank's idea 
that if the patient has been given a plausi- 
ble answer by therapy, this may be suffi- 
cient to produce a cure. 

Dr. Cohen brought out the important 
question, "Should we make a distinction 
between the selection of patients and the 
succeeding with patients?" These are not 
synonymous, although they are some- 
times treated as synonymous ideas. 

Getting back to the "matching" idea, 
Dr. Krasner described in his paper the 
Sapolsky 1 study in which it was appar- 
ently shown that the most effective match- 
ing was based on those cases where there 
were compatible need-systems of the 
Schutz type. 2 (Snyder hoped to make a 
remark, but didn't get a chance, that he 
had confirming evidence of this finding.) 
If one talked about need-systems, such as 
the Edwards (EPPS) system, it may be 
true, but the opposite is true if one is 
talking about a different type of need- 
system, such as altruism versus exploita- 
tiveness. 

During the second half of the after- 
noon we turned to a more specific discus- 
sion of papers, but we covered only one 
set of papers those of Dr. Krasner, 

As you know from the previous discus- 
sions, Dr. Krasner 's interests are in oper- 
ant conditioning, and he was asked to dis- 
cuss some of the situations regarding 
ambiguity, awareness, sensory depriva- 
tion, set, and some of the factors which 

1 Sapolsky, A. Effect of interpersonal rela- 
tionships upon verbal conditioning. /, ahnorm. 
soc. PsychoL, I960, 60, 241-246. 

2 Schutz, W. C. A three-dimensional theory 
of interpersonal behavior. New York: Rine- 
hart, 1958. 
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may affect operant conditioning. His dis- 
cussion was of great interest to the group, 
I thought. He reported one experiment 
in which the expectancies with regard to 
the amount of antipathy and the amount 
of awareness that were demonstrated to- 
ward the patient were varied in four dif- 
ferent ways in a very carefully described 
pattern, and the operant conditioning oc- 
curred successfully, I believe, in those 
where there was strong antipathy, with 
an awareness on the part of the patient 
of what was going on. He described an- 
other interesting pilot study regarding 
manipulative behavior that intrigued all 
of us. In this study the schizophrenic pa- 
tients were made the interviewers or 
examiners, and college students were 
made the subjects, and the schizophrenics 
were taught to reinforce certain behaviors 
on the part of the college students, and 
were told how to do this, by reinforcing 
any self references, but they were not told 
that they were the reinforcers and the col- 
lege students didn't know that they were 
the subjects. Neither was aware of what 
he was doing, and some of us thought it 
sounded a little bit like psychotherapy. 
The students did not know that condition- 
ing took place, as expected, and the 
schizophrenics did condition the college 
students quite successfully rather than the 
reverse, as you might have expected. This 
was found to be not true in the case of 
new admissions, but it was true in the 
case of the patients who had been hos- 
pitalized for some months or more. 

Dr. Cohen raised the very pregnant 
question at this point as to whether in 
these operant conditioning studies it is 
the "Western Electric phenomenon," 3 that 
is, the attention that is being given to 
the patient or the sense of responsibility 
that is being given, which causes the con- 
ditioning to take place, rather than neces- 
sarily the conditioning process. 

" 3 Roethlisberger, F. J., & Dickson, W. J. 
Management and the worker. Cambridge: Har- 
vard Univer. Press, 1939. 



The question was raised by Dr. Strupp 
as to whether we can create an instruc- 
tional setup which produces factors that 
are capable of reinforcing, and whether 
this is comparable to the concepts of 
faith, integrity, placebo, etc. Dr. Krasner 
felt that it was possible, and said that it 
has been demonstrated that one can pro- 
duce a warm psychotherapist, and one can 
also create a hostile atmosphere; that one 
can do any of these things just as one 
wants. Dr. Strupp questioned whether 
you can create an atmosphere just by in- 
struction: how generalizable the operant 
conditioning phenomena findings are to 
psychotherapy, and whether it is possible 
to carry over from the laboratory proto- 
type to therapy. Dr. Saslow proposed that 
even if it is not very generalizable, this 
does not affect the problem very much; 
for example, in the situation of sensory 
deprivation, the individual has to become 
immersed in the environment, and to 
sense a feeling of responsibility. If one 
were to alter the situation he could use 
an operant conditioning model to teach 
the person to control his life in new ways, 

Dr. Krasner brought out that the 
technique which he was describing could 
be used in role- train ing situations as 
well as in psychotherapy situations. He 
described a study in which college stu- 
dents were told that they would be in 
an experiment and they were just to go 
in and talk with patients about sports, 
weather, and other nonrelevant material. 
The patients were told to go in and see 
how well people can count the self -refer- 
ences which other people make, presuma- 
bly the college students, but that the way 
to count this was not by saying, "1, 2, 3, 
4," but rather just to say "uh hunh" every 
time a self -reference occurs, and the re- 
cording machine would pick it up and 
count it for them; then they were able 
to reverse roles. Dr. Krasner was asked 
what he hoped to achieve by this experi- 
ment. He said he felt that it is possible 
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to train the patient in the role of being 
more responsible, with the hope that this 
can be expected to generalize to other 
contexts. 

Dr. Saslow brought up, at this point, 
the important parallel to George Kelly's 4 
concept of the "fixed-role psychotherapy." 
The patient is persuaded to go around for 
a period of time assuming a certain role. 
He is told, "You are a person for the next 
two weeks who loves everybody he meets," 
or something of this sort. Having to do it 
only for two weeks makes it a task that he 
can carry out, and he finds himself even- 
tually functioning in that role with a 
reasonable degree of success. 

Dr. Levinson asked whether this change 
in behavior in the studies can lead to 
"deep** personality changes. Here we are 
back again to the question of the general- 
izability of operant conditioning studies, 
and Dr. Krasner defended his idea by 
raising the large question of the nature of 
personality. He pointed out that it is pos- 
sible to change scores of personality and 
attitude tests, for example, and asked what 
other things ought to be included as per- 
sonality. 

Dr. Betz brought up the interesting 
question of whether the difference be- 
tween her A and B doctors might be due 
to the fact that her B doctors were per- 
petuating the situation of the "double 
bind." That is, they were reinforcing be- 
havior at one level but not managing to 
reinforce it at the other level, so that the 
patient was really finding himself am- 



4 Kelly, G. A. The psychology of personal 
constructs. New York: W. W. Norton, 1955. 



bivalent in terms of how to respond to 
this situation. 

I think Dr. Krasner at this point pro- 
posed a study not yet done, but one which 
might test the situation, in which medical 
students were to be shown examples of 
certain stories, one story by a very schizo- 
phrenic person and one by a college stu- 
dent. The schizophrenic story would be 
loaded with emotional words. He would 
then get the students to tell stories and 
would reinforce them every time they 
used emotional words. Thus, he would be 
producing incompatible drives in the stu- 
dents, the one to be more normal and the 
one to be more schizophrenic in character. 

Finally, we got into a discussion of 
whether the phenomenon that occurs in 
sensory deprivation is due to the existence 
of sheer anxiety. It was pointed out by 
someone that this depends on how much 
anxiety is created, and I think someone 
else proposed that the data have shown 
that the positive expectation of a pleasant 
response will sometimes produce little 
anxiety in situations where anxiety would 
normally be produced, such as walking 
out into a dark place. Other persons elabo- 
rated further evidences of situations of 
this sort. 

It was at about this point that we de- 
cided to conclude our deliberations. I 
personally feel one very valuable con- 
tribution came to me in this situation. 
However pessimistic I might sound about 
what our group accomplished, I found it 
extremely valuable to have met and 
learned to know so many wonderful 
people, all deeply interested in psycho- 
therapy research. Sometimes I think that 
is the main point of these conferences. 



Group Discussion 

DR. DAVID A. HAMBURG, presiding 
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DR. HAMBURG: Thank you, Dr. 
Snyder. The discussion is now open. Dr. 
Luborsky. 

DR. LUBORSKY: I had a comment 
saved up about Dr. Betz's paper. It is 
about the principal finding on the Strong 
test, the discrimination between A and B 
physicians. We found in the project on 
the selection of psychiatric residents for 
training 1 that the Strong test generally 
did not discriminate competence. How- 
ever, on the lawyer key it had a significant 
discrimination (.22 and .23 with the two 
psychotherapeutic competence criteria). 
That is one finding which corresponds 
to yours. It almost leads one to suggest 
facetiously that we are neglecting an 
important resource in lawyers for the 
treatment of schizophrenics! 

DR. BETZ: We have considered this 
point, and at one time discussed the re- 
search possibilities in linking up with a 
law school to see how young lawyers learn 
to interview their clients, and to observe 
the way lawyers go about appraising 
human problems. 

DR. PARLOFF: I was wondering if 
you would suggest lawyers for client- 
centered therapy! But I have a more 
serious question about the A and B ther- 
apist groups. I gather the way an A ther- 
apist was defined was that he was an 
individual who, over a period of time, had 
been successful with three out of four of 
his schizophrenic patients. 

DR. BETZ: A cutoff point of 68% has 
been arbitrarily used for designating doc- 

l Holt, R. R., & Luborsky, L. Personality 
patterns of psychiatrists. New York: Basic 
Books, 1958. 



tors as "A" or "B." This point was selected 
because, in the first exploratory study of 
differences between doctors based on the 
seven most successful and the seven least 
successful doctors, the success rates of the 
seven most successful doctors with their 
schizophrenic patients were found to 
range between 68% and 100%. Each doc- 
tor included in the studies had treated a 
minimum of four schizophrenic, four de- 
pressed, and four neurotic patients. 

DR. PARLOFF: This would imply that 
a long period of time had elapsed between 
the administration of the Strong Voca- 
tional Aptitude Test and the determina- 
tion of an individual's success as a thera- 
pist. What concerns me is that if such 
good predictions can be made prior to 
training, what impact, if any, does the 
training period have on the therapist? 
That is, your data suggest that an A thera- 
pist is an A therapist and a B therapist is 
a B therapist regardless of his subsequent 
training. In your experience does the 
training program transform a B therapist 
into an A therapist? 

DR. BETZ: Some years ago I checked 
a series of A and B doctors in terms of 
their success rates with schizophrenic pa- 
tients in their first, second, and third years 
of residency. The A doctors achieved 75% 
improvement in each of the three years; 
the B doctors remained below 30% in 
success rates in each of the three years. 
However, there are undoubtedly doctors 
in whom A and B characteristics are 
mixed, and who might be assisted to culti- 
vate their A characteristics with schizo- 
phrenic patients if properly informed and 
motivated. 
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DR. GLAD: Does this suggest that 
residents in psychiatry are more unmodi- 
fiabie than patients? 

DR. BETZ: I think that our studies 
raise the question as to whether there is a 
general good therapeutic personality, or 
technique which any therapist can culti- 
vate and use effectively for any kind of 
patient; or whether there are actually a 
number of aptitudes or skills, cultivatable 
by some doctors but not by others, and 
effective for some patients and not for 
others. There may be differences in the 
problems that patients have, and in the 
capacities of physicians to assist in the 
solutions of these different problems. 

DR. HAMBURG: This question Dr, 
Glad has raised reminds me of a comment 
that Norman Polansky made at a confer- 
ence some years ago about an institution 
he studied. He said the difference between 
the patients and the staff there was that 
the patients got better. (Laughter.) 

DR. LORR: In general we found just 
about the opposite of what Dr. Betz 
found: B type therapists were most suc- 
cessful with neurotic patients. Our criteria 
for success were various self-report data 
as well as therapists' judgments of change. 

DR. COLBY: I wanted to elaborate a 
little bit on a point that came up in our 
group. If you talk to analysts who are re- 
sistant to research, some of the things they 
say are: "The subject is so complex." 
'There are so many variables." "If you 
tape record four years of analysis you've 
got 38 miles of tape and how are you 
going to handle all of this?" And they 
throw up their hands. But if you sit down 
with them and talk to them about a single 
hour, they will say, "Well, you know there 
are only one or two themes in this hour." 
Or if you sit down with them for an hour 
and talk about a whole analysis, they will 
boil it down to a few themes characteristic 
of the patient. Maybe if we look at our 
data this way, every case might be viewed 
as comprising only 10 to 50 themes. A 
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theme represents not a variable but a re- 
peated combination of variables such as 
words or utterances which make up a 
paragraph having a point. If we could 
look at the research situation in this way 
there is no insurmountable complexity at 
all. It is no more complex than anything 
else in life. If we would reduce data to 
themes and try out different combinations 
of themes, then we would have a feasible 
approach to data reduction. I think we are 
of sufficient age now in psychotherapy re- 
search to stop whining about the com- 
plexities of the subject matter first, be- 
cause complexity is a property of any sub- 
ject matter, and, secondly, we now have a 
set of known physical mechanisms, the 
digital computer, which can handle any 
degree of complexity that any human 
being can think up. 

DR. SHAKOW: I would go along with 
you if this is what you want to do. If you 
want to study the themes over 500 hours 
of analysis and come up with a dozen 
themes, you can do that. But if you want 
to find out how a process of relationship 
gets established, then you have to examine 
the details of the process. I don't think 
that you can ask one question about 
therapy. You ask different kinds of ques- 
tions. For some people the epitome of an 
hour is enough. Others must have not 
only the full film of the hour, but need 
also all the associations of the therapist 
during the course of the time that he is 
interacting in the situation. I think that 
we have different kinds of purposes in 
approaching therapy. There has been a 
tendency either to overemphasize its com- 
plexity or to underemphasize it. Therapy 
is quite simple when looked at in some 
ways. My usual answer to analysts who 
tell me about how complex the process is 
and how impossible it is to analyze the 38 
miles of tape is that I am not interested in 
analyzing 38 miles of tape. We just want 
the material available so we can ask dif- 
ferent kinds of questions from the tape. 



GROUP DISCUSSION: THERAPIST'S CONTRIBUTION 



265 



At one time I have one kind of question, 
at another time I have another question, 
and the data are there available for me to 
put the question to. 

DR. COLBY: Since people like to com- 
plain about the complexity of a subject 
matter, I wanted to point out that it all 
depends on the degree of complexity you 
yourself have chosen to work at. Certainly 
300 sentences might all concern what we 
could agree on to be the same theme, so 
we have reduced them down now to one 
phrase or sentence. This is the sort of 
approach used by people working in com- 
puter simulation of cognitive processes. 
For example, they give problems in sym- 
bolic logic to people and ask them to solve 
the problems out loud. The spoken de- 
scriptions are taped, and the simulation 
theorist listens to these tapes trying to 
abstract from them how the subjects go 
about problem-solving. What are their 
heuristics, what are the themes, how is it 
being done? He writes a program contain- 
ing what he guesses to be the essence of a 
great wealth of observable detail. He then 
runs this program on a computer and sees 
if the inferred causal processes contained 
in the program can generate a trace from 
the machine that is reasonably similar to 
the trace generated on the protocol tapes 
by the subjects. This kind of approach 
seems promising to me because it is what 
the computer up here in the head, the 
wet, soft ware of the psychotherapist, is 
really doing. The clinician is finding 
themes and inferring heuristics from 
thematic data and these are what he is 
responding to and interpreting in his 
work. 

DR. BOLGAR: I just wanted to say 
that by and large the people who collect 
miles of tape are not nearly so over- 
whelmed by the data as one might think. 
Somehow, people who get started on col- 
lecting exhaustive data have some idea 
why they want them and they seem to be 
able to tolerate having the material with- 



out necessarily using all of it. Usually it is 
the people who don't collect data this way 
who are so concerned about "What are 
you going to do with all this?" I think it 
is important to have both kinds of data 
collection wasteful and economical. 

DR. SASLOW: I wanted to draw to the 
attention of the group that the ingenuity 
of some of the things that Dr. Krasner 
was describing could well be communi- 
cated by a particular example. I was going 
to urge Dr. Krasner to describe those ob- 
servations of his based upon information 
that behavior ratings are correlated with 
affective words and how he used this in- 
formation experimentally. 

DR. KRASNER. First, I want to thank 
Dr. Snyder for his review of the illustra- 
tions of this type of approach. In listening 
to his review, it sounded as if we have 
undertaken a relatively simple task. I want 
to point out that, on the contrary, we are 
running into a considerable amount of 
complexity. I do not think they are quite 
the complexities of the order of the 300 
yards of film, but they are related to Dr. 
Bordin's comments on simplification and 
oversimplification. I am not sure whether 
we are oversimplifying, but for a simplifi- 
cation our problems are quite complex. 
Dr. Snyder and others referred to the 
studies of behavior manipulation as lab- 
oratory studies. In one sense this may be 
true, but I feel that what is too frequently 
implied is that "laboratory" studies are 
divorced from reality. Often the so-called 
laboratory studies are contrasted with the 
"real-life" psychotherapy situation. I feel 
that psychotherapy itself can just as well 
be termed a laboratory situation. The dif- 
ferences between the two types of studies 
are not in terms of one being "real-life" 
and the other "laboratory," but these dif- 
ferences are in terms of role expectancies, 
task orientation, instructional set, etc. It is 
erroneous to imply that one situation is 
more "real" than the other. Both are 
laboratory situations which investigate 
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real-life interpersonal situations under 
various conditions. 

The study that Dr. Saslow was referring 
to was a study using change in group 
therapy behavior as an outside criterion 
associated with verbal conditioning. This 
is part of a series of studies in which we 
are concerned with outcome criteria. We 
selected a class of behavior to reinforce 
which we felt would be relevant to be- 
havior in another situation. We used pa- 
tients who were in group therapy, and 
requested that the therapist rate the pa- 
tient's behavior on a formal rating scale. 
The patients then were placed in one of 
three experimental groups. All three 
groups were requested to perform a story- 
telling task in four separate sessions over 
a period of two weeks. In the first group, 
emotional words were followed by the 
verbal reinforcer ''mm-hmm." In the sec- 
ond group, emotional words were fol- 
lowed by an impersonal "clicker." In the 
third group, the patients came in and 
simply told stories without any kind of 
reinforcement. We predicted that the be- 
havior of the patients receiving positive 
personal reinforcement would change in 
a desirable direction in the group because 
previous studies had shown a direct rela- 
tionship between the use of emotional 
words and patient behavior in group 
therapy. However you look at it, it would 
make sense, because therapists consider 
that it is "good" for a patient to talk, to 
use emotional words. Our results indicated 
that we could influence the group therapy 
behavior by the kind of reinforcement we 
gave in the experimental situation. That 
is, the group that received the interper- 
sonal reinforcement, the ''mm-hmm," 
significantly improved in their rated be- 
havior at the end of the two-week period, 
as compared with the other two groups. 
Of course, the therapist did not know in 
which procedure his patients would be in- 
volved, or even the purpose of the study. 

DR. BLOCK: The therapist was the 
reinforcer? 



DR. KRASNER: No, the group thera- 
pist was not the reinforcer; he was a com- 
pletely different examiner. 

DR. SASLOW: How many days 
elapsed between your last experimental 
reinforcing session and the first group 
therapy testing session? 

DR. KRASNER: The group therapist 
rated the patient on his behavior in group 
therapy immediately prior to the experi- 
mental sessions. These sessions lasted over 
a two-week period. Within a day after the 
end of this two-week period the group 
therapist then rerated the patient. 

DR. SHAKOW: He had additional 
sessions, didn't he? 

DR. KRASNER: Yes. 

DR. SHAKOW: He wasn't rating 
them again? 

DR. KRASNER: No. He rated them 
based on his observations of their be- 
havior in the group therapy session. 

DR. SHAKOW: What was the infer- 
ence? I think this is the crucial thing. 
What was the inference from that? 

DR. KRASNER: The inference was 
that we changed behavior in one situation 
with the purpose of influencing behavior 
change in another situation. I might point 
out that we have replicated this study on 
another group. We found the same results 
as in the first study when we used patients 
who had been hospitalized three or more 
months. When we used a group of pa- 
tients who had been hospitalized for less 
than three months' duration, we did not 
get change in behavior in the group 
therapy situation. We do not contend that 
we have made any long lasting changes in 
these patients. However, these studies are 
presented as an example of a technique to 
approach this question of outcome. What 
we are doing is investigating the relation- 
ship between systematic behavior change 
in one situation and consequent change 
in a criterion situation which is related to 
the first situation. 
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DR. SHAKOW: Haven't you contami- 
nated your rater? 

DR. KRASNER: Oh, no. 

DR. SHAKOW: Of course you have. 
No, you have not done anything to your 
patient naturally. You have taught him to 
say certain kinds of words more fre- 
quently to use warmer words. Secondly, 
you have introduced an artificial factor 
into a situation where you ordinarily ex- 
pect no other particular emphasis during 
the course of therapy. Ordinarily with 
the progress of therapy there may be an 
increase in the number of emotional 
words, words which presumably carry 
with them certain kinds of affective values. 
But here you have introduced another 
kind of factor which has through an 
extraneous device increased the number 
of warm words that you had without the 
therapist knowing about it, and not re- 
lated at all to the therapy. The therapist 
mistakenly judges these warm words be- 
fore him as being the warm words which 
have affect related to them. You then have 
two kinds of warm words, don't you? The 
point is similar to the one I was making 
previously with Dr. Saslow. He used the 
word "affect laden," and I raised the ques- 
tion whether they were "affect laden" or 
just affective words. This is the question 
I have. 

DR. KRASNER: We are not saying 
that we have increased the amount of 
emotional words used in group therapy. 
We do not know specifically what causes 
the change in group therapy behavior. It 
may have been the fact that these patients 
went through a positive personal reward- 
ing experience. This may have influenced 
their behavior to the extent that they in- 
creased their use of emotional words and 
thus appeared better to the therapist. 
However, the study is uncontaminated in 
that all three groups went through the 
same experience except for one thing, the 
kind of reward they received. 

DR. SASLOW: There is one point I 
am not clear about. As I understood it 



from him, Salzinger was rating words. He 
had a behavior rating something like Dr. 
Betz. 

DR. SHAKOW: That's right. What I 
am saying is that there is an assumption 
in the whole experiment in the way the 
rating scale was used and the judgments 
made in evaluating the patient. This was 
on the basis of the kinds of things that 
the patient said in the hour. If he said 
"emotional" words without necessarily 
having the "expected" emotional connota- 
tion this was the basis for the therapist 
thinking of the person as being in a better 
condition. 

DR. BLOCK: I do not know enough 
of the experimental design employed to 
speak precisely, but I understand Dr. 
Shakow's point to mean that a given affec- 
tive word may be mediated or intended 
in several different ways. It may be genu- 
inely affect laden or it may be simply 
affect labeled. Simply recording the emis- 
sion of the word does not clarify the kind 
of emotional significance that word hap- 
pens to have in the context. 

I fully agree with Dr, Krasner's sugges- 
tion that psychotherapy is a highly arti- 
ficial and laboratory situation. Moreover, 
I think the orthodox psychotherapist 
would countenance this at first glance 
provocative interpretation. The difference 
between the operant conditioning situa- 
tion and the psychotherapy situation is 
not their comparative artificiality or real- 
ness. Rather, the difference relates to the 
extent of emotional involvement that de- 
velops in the one situation as compared 
to the other. As a second, related point, I 
would acknowledge the rephrasing that 
psychotherapy is intended to create be- 
havior change, and that operant condi- 
tioning also is intended to create behavior 
change. But because both procedures are 
intended to create behavior change does 
not mean therefore an equivalence rela- 
tion between psychotherapy and operant 
conditioning. The way behavior change is 
mediated in psychotherapy seems to me 
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to be radically different from the way 
behavior change is mediated in the 
operant conditioning situation. This is a 
fundamental difference that I think ex- 
plains the concern, irritation, and some- 
times hostility that operant conditioners 
who claim they are involved in psycho- 
therapy are receiving from more orthodox 
psychotherapists. I suppose considerations 
of threat to the ensconced from the un- 
orthodox are involved here. But the 
operant people would do well to remem- 
ber that so far their demonstrations of 
behavior change have not been demon- 
strations of changes affecting value sys- 
tems or underlying behavioral premises 
or the integrative capacity of the indi- 
vidual. All of these are changes that we 
have reason to believe successful psycho- 
therapy helps bring about. It is these 
kinds of changes that operant condition- 
ing must also seek to achieve if it aspires 
to be viewed as a model of psychotherapy. 

DR. HAMBURG: I am going to ask 
Dr. Krasner to make a brief closing re- 
mark for this session. 

DR. KRASNER: One of the comments 
often made is that the subject in condi- 
tioning studies is merely trying to please 
the experimenter. Of course, this comment 
could also be made about "real" psycho- 
therapy. To some extent I think that this 
is true. The question would then be, 
"What are the personality correlates of 
the individual who tries to please?" This 
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is a question that is relevant for both kinds 
of situations, therapy or conditioning, and 
the operant conditioning studies again 
give us a technique of investigating this 
problem. I might add that there has been 
considerable difficulty in getting clear-cut 
personality correlates of responsivity to 
conditioning. As for the reported failure 
of replications, I found in reviewing the 
literature that approximately 30% of the 
verbal conditioning studies reported nega- 
tive results. Although one may assume 
that there are further negative studies un- 
reported in the literature, this figure is 
interesting because of its similarity to re- 
ported figures on lack of success in "real" 
psychotherapy. We now know that there 
are a number of ways, such as instructional 
set and atmospheres, which affect the in- 
fluenceability of the eaxminer. I think we 
will find that the same kinds of variables 
which affect effectiveness in operant con- 
ditioning also affect effectiveness in psy- 
chotherapy. Just as there are psychothera- 
pists who are more "effective" than others, 
there are also operant conditioners who 
are more "effective" than others. I think 
that Dr. Saslow and Dr, Matarazzo are on 
the right track in their investigation of the 
relationship between attitude of the ex- 
aminer toward conditioning and his effec- 
tiveness as a conditioner. 

DR. SASLOW: We considered it be- 
cause we were suspicious of it. 

DR. KRASNER: Yes. 



Summary Report: Measuring Personality Change (A) 



IAN STEVENSON, MJD. 



Our group had difficulty in agreeing on 
its purpose and assignment, and the best 
way of spending the available time. Half 
the group seemed to be interested in dis- 
cussing problems relating to the measure- 
ment of particular functions and how this 
might be accomplished; the other half 
favored discussing the theory of measure- 
ment what do we aim to measure? In 
general we thought the assignment was 
too broad to accomplish these tasks, and 
I am sorry to say that none of us thought 
we had succeeded with either. But, in the 
course of the day, we managed to take up 
a number of important points. 

We spent most of our time certainly 
in the morning discussing the measure- 
ment of anxiety. Anxiety was considered 
as a major variable, which should be 
measured in any effort to evaluate change. 
We discussed at some length various 
available methods for measuring anxiety. 
We also noted and deplored the fact that 
often the various measures do not corre- 
late with each other. 

Dr. Lorr made an excellent point by 
reminding us that many measures of 
anxiety particularly questionnaires and 
rating scales fail to specify the time 
dimension. Thus a person may have had 
marked anxiety throughout life, or at dif- 
ferent periods of his life, yet he might at 
the moment experience very little anxiety. 
Therefore, the current state of anxiety 
may show little relationship to his earlier 
history of anxiety. 

We proceeded to discuss the possibility 
that anxiety, as currently experienced, may 
have little relationship to the outcome of 
psychotherapy. Examples were given of 
patients whose anxiety had actually in- 
creased rather than abated during the 



course of what seemed to be successful 
therapy. Some of these persons had be- 
come more adventurous as a consequence 
of therapy and had exposed themselves to 
situations which they had formerly 
avoided. Therefore, an instrument measur- 
ing the global level of anxiety assuming 
that this could be done before and after 
therapy would not always be a reliable 
guide to the success of the therapy. 

It was also pointed out that an experi- 
ence of anxiety in therapy may be helpful. 
Some said it may even be essential for 
successful outcome. This led into a fur- 
ther discussion of the concept of anxiety 
tolerance. Often patients continue to have 
considerable anxiety in a wide variety of 
situations, yet they may respond different- 
ly to the anxiety experience. This may 
signify definite improvement, but it might 
not be apparent if the patient's level of 
anxiety alone were regarded as an index 
of outcome. 

Next, we considered that the degree of 
the patient's discomfort should not be re- 
garded as the only significant variable to 
be evaluated at the beginning or at the 
end of therapy, although it of course pro- 
vides important clues. In the past too 
much importance has been attached to 
simple evaluations of the patient's subjec- 
tive state before and after therapy. We 
also know that many patients enter 
therapy not only because of their own dis- 
comfort but because of the distress they 
are inflicting upon others. What these 
other people think of changes in the pa- 
tient should be given at least equal weight 
along with the patient's self -evaluation. 

We discussed at some length criteria 
for improvement and some of the hazards 
in evaluating criteria. Many of the com- 
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monly accepted criteria of mental health 
are in fact the therapist's projections and 
are a result of his immersion in our cul- 
ture. Sometimes the therapist's personal 
biases influence his evaluations of out- 
come. Some therapists assume that if a 
patient has had many hours of therapy, he 
should show greater improvement than a 
patient who had fewer hours of therapy. 

We spent some time discussing meth- 
ods of measurement. I am going to men- 
tion four points on which our group 
seemed to agree: ( 1 ) The therapist him- 
self is not an adequate judge of treatment 
outcomes with his patients we should 
not place sole reliance upon one rater. It 
is also asking too much of the patient to 
be the sole judge of his own improve- 
ment; the opinions of others should be 
sought and considered. (2) We need 
something more than global ratings of 
changes in the patient. We should aim at 
ratings in which changes are specified in 
some detail. For example, a patient may 
show symptom improvement but his 
social adjustment may have deteriorated, 
or vice versa. Dr. Lorr mentioned an 
itemized scale of this kind that he has 
developed. (3) It is difficult to measure 
change in absolute terms; it may be easier 
to rate movement within a specified area. 
(4) Finally, we should develop scales or 
other measures having wide applicability 
if not across the nation, at least in a 



variety of treatment centers. These centers 
might then begin to compare their respec- 
tive results. Clearly, many efforts are being 
made to measure personality change, but 
the methods vary widely. Thus, it would 
be helpful to achieve a degree of uni- 
formity and comparability. 

I have given a more or less chrono- 
logical account of our discussion, as I 
remember it. Before closing, however, I 
wanted to mention a contribution by Dr. 
Glad, to which I cannot do justice in a 
few minutes but which was fruitfully dis- 
cussed at some length by the group. Dr. 
Glad had made an effort to isolate com- 
mon factors in the various invited papers 
and presented these to the group. The two 
essential ingredients of successful therapy 
to which Dr. Glad drew our attention are 
(a) an atmosphere favorable to learning, 
and () some kind of curriculum or sys- 
tem of values toward which the patient is 
expected to change. 

Finally, I should mention that we spent 
a good deal of time discussing the differ- 
ences and similarities between education 
and psychotherapy. Some participants 
thought of psychotherapy as a species of 
education, whereas others viewed the two 
pursuits as completely different. A third 
group tended to think that they shared 
common features but, also, that there were 
extremely important differences. 



Summary Report: Measuring Personality Change (B) 



JACK BLOCK, PH.D. 



I anticipate difficulty in avoiding re- 
dundancy with the reports of Dr. Hag- 
gard and Dr. Bordin, by virtue of common 
elements in the definitions of our group 
topics, and I expect that they will deal in 
their remarks with matters upon which 
we too had focused. I think perhaps all I 
can offer is a further emphasis of some 
points made by Dr. Stevenson and a possi- 
bly constructive suggestion. The sugges- 
tion is really an affirmation of a possibility 
which might be rather immediately denied 
by some, but I will affirm it anyway. 

Our group was concerned much with 
theory versus empiricism, the question 
being whether measures could be em- 
ployed or selected without an underlying 
theoretical basis. All of us are concerned 
with this issue, of course, but I myself 
chose for crass empiricism in this particu- 
lar situation because it seemed to me, as 
evidenced in the course of our discussion, 
that the several theories available have 
proved not to be very different after all in 
the way they have guided the selection and 
construction of measures. 

Regardless of the theoretical persuasion 
of the participants in our group, every- 
body agreed there was such a thing as 
anxiety and that anxiety was important. 
Everyone also agreed that there were 
methods of coping with anxiety call 
these methods defenses, ego structure, 
character style, or what have you that 
were theoretically and functionally quite 
separate from what we call anxiety. Also 
judged as of decisive significance was 
reality, the environmental context, society 
what is out there. 

Here were three classes of variables or 
categories anxiety, character structure, 
and social context that somehow were 



conceptually separate but had to be inte- 
grated and related to each other. If I read 
the group correctly, it is no longer profitable 
to think in global, undifferentiating terms 
but instead one has to look at the situation 
of the individual and compartmentalize it 
into something akin to this tripartite di- 
vision: (a) the individual's level of anx- 
iety, (b) the individual's anxiety-dealing 
mechanisms, and (c) the formal charac- 
teristics of the social context in which the 
individual finds himself. Having made 
this analytic separation, then hopefully 
rules of integration can be formulated 
bringing these elements together again 
and recreating in a psychologically rele- 
vant and incisive way the circumstance of 
the individual, where he came from, and 
where he is going to go. 

Now, if all the viewpoints advanced 
agree on or do not find intolerable a con- 
ceptual outline such as this, then it would 
follow, it seems to me, that we should be 
able to achieve some uniformity in the 
way these various broad concepts or cate- 
gories are made operational. I would wish 
we could have devoted more time to this 
aspiration in our group. There was a re- 
mark made during the course of our dis- 
cussion to the effect that we already had 
too many measures, the field being littered 
with alternative measurement procedures. 
The implication of this view was that 
what we really needed now was some 
theory to orient and organize these meas- 
ures. My own feeling, however, is that we 
do not have so very many measures after 
all, that although there is multiplicity 
there is also astonishing redundancy. With 
the data available presently and with 
some straightforward psychometric analy- 
ses, we should be able to discard large 
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numbers of redundant measures. The sim- 
ple act of throwing out a lot of measures 
only trivially different from other meas- 
ures would, I think, help the field enor- 
mously. Findings could become cumula- 
tive and be seen to dovetail where, pres- 
ently, seemingly different measures pre- 
vent that perception. In the clarified 
atmosphere following upon the elimina- 
tion of duplicating measures, we might be 
able to construct new and genuinely dif- 
ferent measures. I do not believe we have 
yet plumbed the possibilities of construct- 
ing measures that indicate more usefully, 
and more deeply, the processes that go on 
in psychotherapy and the kinds of changes 
we are trying to bring about. 

And so, by this chain of reasoning or 
hope, I am led to my suggestion. I wonder 
whether it might be considered fruitful to 
form a group that would attempt to sur- 
vey the literature, and become familiar 
with the various researches going on that 
have not yet been reported in the litera- 
ture. This group would evaluate in depth 



the measures that have been used, perhaps 
carry out certain comparisons of its own 
and then propose a small select set of 
measures for research in psychotherapy 
that hopefully would do the job the whole 
panoply of measures is represented as 
doing now. Certain measures would be 
suggested for recording the individual's 
levels of anxiety over time, other measures 
would have demonstrated their capacity 
for reflecting character structure and 
changes in character structure, still other 
indices would specify the properties of the 
social setting of the individual. 

A small, cogent battery of measures 
would not prevent researchers from add- 
ing favorite procedures of their own. 
There would still exist the option of pur- 
suing special hunches and theoretical in- 
clinations. A small, hard standardized core 
of procedures, however, would bring the 
possibility of aggregating and interlocking 
findings where, presently, results have soli- 
tary import. 



Group Discussion 

DR. DAVID A. HAMBURG, presiding 



Measuring Personality Change 



DR. HAMBURG: We are again very 
much indebted to those whose reports 
have given us a remarkably clear and co- 
herent presentation. Now, for the discus- 
sion. 

DR. LUBORSKY: I would like to de- 
scribe further three ideas which came out 
during our panel discussion on the meas- 
urement of change. These are especially 
worth pursuing in our research centered 
at The Menninger Foundation. 

The suggestion by our panel to make 
ratings of different types of anxiety, I be- 
lieve, can fruitfully be investigated even 
within the present data of our project. In 
the Menninger Psychotherapy Research 
Project, Form B, we made a thorough 
survey of six or seven varieties of each 
patient's anxiety. In my paper I utilized 
only one composite form of anxiety 
observers' judgment of the amount of the 
patient's anxiety (whether manifest or 
averted ) . I can go back now to the Form 
B descriptions and get separate ratings on 
these varieties of anxiety and see whether 
we get different relationships between the 
form of anxiety and change. 

Secondly, I notice that the results of 
several studies referred to by participants 
in this conference may dovetail with ours. 
For example, there were some findings 
described by Dr. Hunt, from his psycho- 
therapy research studies, on the relation- 
ship between anxiety and change. Some- 
thing comparable may be evident in Dr. 
Butler's study in the relation of Factor I 
and change. And Dr. Lorr finds that pa- 
tients who have greater anxiety stay in 
treatment. It was mentioned in our panel 
that there may be some opposite findings 



in the literature which report a negative 
relationship between level of anxiety and 
change. 

This brings me to the third point that 
came out in our discussion. It bears stress- 
ing. I would predict that further research 
studies on this relationship between level 
of anxiety and change will turn up diver- 
gent results. These will be explainable in a 
way that we should all anticipate. The 
results will depend upon the subject group 
being studied. The correlation will differ 
for patients at the low versus high end of 
the Health-Sickness Rating Scale. It will 
pay to be sophisticated about the character 
structure of the patients in relation to the 
level of anxiety if we are to get further 
in understanding any correlations. 

DR. STRUPP: I wonder what criteria 
this small group advocated. In this connec- 
tion, I was thinking of a recent article by 
Zax and Klein 1 which delineated three 
common types of criteria in psychotherapy 
research: (a) intratherapy measures, such 
as changes in the patient's verbal com- 
munications within therapy, (&) self- 
ratings by patients describing their own 
status, which were rejected by these au- 
thors as being for the most part inade- 
quate, although they may still be a source 
of valuable information, and (c) outcome 
criteria external to the therapeutic rela- 
tionship. These would include behavioral 
changes that could be observed by others, 
but which are still to be developed. These 
authors strongly favored the third group 
of behavioral criteria. Everyone is aware 
of the problem of agreeing on a universal 

1 Zax, M., & Klein, A. Measurement of per- 
sonality and behavior change following psycho- 
therapy. PsychoL Bull., I960, 57, 435-448. 
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set of criteria. We also know that the in- 
terrelationships of criteria are rather vari- 
able. I was wondering whether the mem- 
bers of the small group that was just 
reporting might wish to comment on the 
problem of selecting criteria, how they 
might be interrelated, and how we might 
come to a better approach of what cer- 
tainly is one of the most important prob- 
lems in psychotherapy research today. 

DR. COHEN: I want to make a com- 
ment about the concept of anxiety, be- 
cause it is so important and yet it has 
become more and more a catchall for our 
concepts of what is wrong with people, 
what causes malfunction in patients, and 
what is a criterion of improvement, and 
also what is a sign that therapy is going 
well. One thing I think I do a great deal, 
and I think I am catching other people 
here doing, is to assume that anxiety exists 
as a kind of entity, sort of like libido used 
to exist, as a thing which has attributes 
both of quantity and quality which are 
open to observation and to measurement. 
I would like it if this were so, but I doubt 
it very much. I have spent a great deal of 
time in the last 20 years in mulling over 
this question of what anxiety is and what 
this whole concept means, and have never 
so far arrived at anything in my own 
thinking that even approximates an an- 
swer to this question. 

I am fairly sure that in order to deal 
with anxiety intelligently you have to con- 
sider it to be a process rather than an 
entity, and that we do not as yet know 
enough to define this process or measure 
its changes, either from the theoretical or 
from the operational point of view. I 
would just like to throw that skepticism 
in and see whether anybody else funda- 
mentally differs with me. 

DR. STEVENSON: Certainly I think 
this is where we got stuck, since part of 
our group felt that the question you have 
raised, Dr. Cohen, is paramount and that 
we should not go on until we have dealt 



with it in some way. Others, however, did 
think that you can get some kind of meas- 
ure of magnitude of discomfort as re- 
ported by the patient for his life span. 
And you can also get some measures of 
the range of stimuli which can initiate 
discomfort that he has. So, we are not 
completely at sea with regard to the possi- 
bility of measuring change in relation to 
the concept of anxiety. 

DR. LEVINSON: On the question of 
the assessment of anxiety, the suggestions 
that have been made as to how we go 
about this are still mainly two, as far as I 
can see. One is what the therapist can 
judge on the basis of his impression of 
the patient at the end of treatment. The 
other is what the psychologist, as diag- 
nostician, can learn through the use of 
tests, projective or otherwise. I imagine 
this was another controversial issue in the 
meeting, and I think it is worth general 
discussion. 

What about other ways of getting at 
the level and kind of anxiety of the pa- 
tient? My own preference here is that 
both the therapist and whatever tests we 
can develop should be used for this, but 
in addition we have to widen the base of 
our experience in assessing anxiety or any 
other aspect of personality, by some kind 
of observation of the patient in his every- 
day life. I personally am not ready to 
assume any more that either the therapist 
or psychological tests of any kind give a 
sufficient basis for saying, "What's going 
on with regard to anxiety in the patient?" 
We have to look at what he is the way 
he is living in the family or at work or 
with his friends, not simply for the sake 
of describing this, not to get involved in 
other things necessarily, but as a means of 
learning about the way in which his inner 
dispositions are activated in various en- 
vironmental settings and how he is coping 
with these. Until we get beyond the office 
the therapy or the test situation we 
are going to be severely limited in the 
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significance of the things we can say about 
how the patient has changed. Therapists 
and personality researchers have tended to 
limit themselves to what they can learn 
in an office. 

DR. SHLIEN: We also said that we 
should not devote ourselves entirely to 
tracking down the intricacies of anxiety, 
but that the other side of the coin the 
tolerance, or coping mechanism might 
be the essential feature. I hope well take 
up the questions raised by Drs. Strupp 
and Block, and keep in mind that we must 
do more than devise measures dealing 
with pathology at the presenting level. 
We will also need to devise measures to 
deal with the tolerance level and coping 
mechanisms which are the significant 
things at the end of therapy after anxiety 
is no longer critical. 

DR. HAGGARD: I suspect that one 
of the main difficulties with the variable 
of anxiety is not that it cannot be esti- 
mated or rated meaningfully but rather 
that it is often defined too generally or 
globally. If, for example, a single over-all 
measure of anxiety is used at the begin- 
ning and end of therapy to measure 
change, it is probable that such a variable 
would have to lump together so many fac- 
tors that, as a measure, it would lose much 
of its meaning. From the standpoint of 
psychoanalytic theory, or even learning 
theory, we are led to believe that symp- 
toms or other things talked about in 
therapy generally result from experiences 
laden with anxiety, and that in order to 
work them through, the associated anxiety 
is often reinstated during that phase of 
the therapy. Consequently, the anxiety re- 
lated to a particular symptom or area may 
wax and wane as therapy progresses, so 
that under certain circumstances an in- 
crease in anxiety might be a sign of prog- 
ress in therapy, and only at a kter date 
would a decrease in anxiety indicate prog- 
ress. Perhaps, like my earlier comments 
about the importance of dealing with con- 



tent, I am suggesting the need to tie our 
methods to the particular aspects of what 
seems to be going on in psychotherapy 
and, if possible, to use a set of differenti- 
ated measures that correspond as closely 
as possible to the events in the thera- 
peutic process. 

DR. LUBORSKY: Several participants 
have emphasized the necessity of being 
more precise about the kinds of anxiety, 
and the difficulties of definition. I would 
like to add some content to this. 

Dr. Helen Sargent 2 made a classification 
which we use in our project for describ- 
ing the forms of anxiety of each patient. 
Anxiety turns out to be, as Dr. Cohen 
would anticipate, a very complicated kind 
of concept. It can be sliced in many differ- 
ent ways. First of all, you can classify the 
intensity of the anxiety. Secondly, you can 
discuss how the anxiety is evident. Under 
this there are two main ways it is evident 
manifest or averted. Under each of 
these headings you can make many sub- 
classifications. For example, manifest 
anxiety can be free-floating anxiety or it 
can be attached to specific experiences, 
and this, I believe, would tie in with the 
point Dr. Levinson is emphasizing. We 
specify to what situations, as well as ideas, 
the anxiety is attached. We do not actually 
go out of the office and follow the patient 
in his everyday life, although we do inter- 
view his relatives and, where possible, his 
employer as well. Manifest anxiety also in- 
cludes "anxiety expressed as tension." We 
all know dozens of behavioral manifesta- 
tions of anxiety, autonomically and mus- 
cularly, in terms of mannerisms, word 
blocks, respiratory symptoms, and so on. 
The catalogue is huge. 

Under "averted anxiety" there are also 



2 Wallerstein, R. S., Robbins, L. L., Sargeat, 
Helen, & Luborsky, L. The Psychotherapy Re- 
search Project of The Menninger Foundation. 
Eull. M&winger Clin., 1956, 20, 221-278; cf. 
pp. 241-242. 
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many subclassifications. We mean by 
"averted anxiety" the way anxiety is kept 
from awareness by some defensive ma- 
neuver. For example, the first subcategory 
is "How is the anxiety bound?" Is it 
bound in particular compulsive symptoms, 
so that you don't see the anxiety, you 
must infer it, and infer that it is averted 
by a particular defensive operation. The 
anxiety may be averted by "episodic dis- 
charge," for example, alcoholic binges or 
promiscuity. Another large classification 
is the varieties of awareness the patient 
has of the anxiety. 

All of these varieties are included in 
our assessment of the global "level of 
anxiety" and in the paper for this confer- 
ence. It is a curious thing. One can get 
high reliability among observers even 
though one cannot specify perfectly clear- 
ly the content of a variable. Judgments of 
"mental health" provide another example 
of a global term which can be reliably 
rated. 

DR. BETZ: The patient's own attitude 
toward the anxiety he feels is also an im- 
portant variable. 

DR. HAMBURG: On the question of 
coping behavior, one factor that has con- 
tributed to a certain impoverishment in 
attempts to deal with these issues has to 
do with the concept of defense. The con- 
cept of defense I think has an arbitrarily 
restrictive effect upon the analysis of 
coping behavior, since this concept and its 
subdivisions are largely preoccupied with 
minimizing recognition of threatening 
elements in the individual's life. It does 
not deal in any penetrating way with a 
very wide range of problem-solving be- 
havior that would be highly pertinent to 
changes in therapy. Therefore, I think it 
would be useful to employ a broader con- 
ceptual scheme that would include the 
usual concept of defense within it as one 
important class of coping behavior, but 
would also take into account the wider 



range of problem-solving functions that I 
think we would really have to deal with 
if we are seriously going to consider the 
whole range of changes in therapy that we 
ordinarily would designate as improve- 
ment. The same kind of consideration ap- 
plies to the analysis of adaptive behavior 
in relation to psychological stress which 
is quite important in psychotherapy. 

DR. SASLOW: I have always thought 
that Norman Cameron's way of dealing 
with this dilemma was a helpful one. He 
proposed the term, habitual adjustive 
techniques, and in that way got away from 
the more restrictive connotation that one 
always acted in defense of something. I 
think his concept is a much more natural 
one from a biologist's point of view in 
that it is congruent with concepts highly 
useful in studying all organisms within 
the evolutionary framework, 

DR. COLBY: In certain areas of psy- 
choanalytic theory the definition of de- 
fense is becoming increasingly restricted. 
If you think of the psychic apparatus as 
having an initial state and an input is 
made into it, one way the input can be 
handled is through an integrative mode. It 
is somehow mapped into the initial state 
without difficulty. The second way would 
be an accommodative mode in which the 
input comes into conflict with the initial 
state and is adjusted to without distortion. 
The third is a defensive mode of handling 
conflict which is pathological. That is, the 
input of information producing conflict is 
split off or distorted or deflected so that 
the resultant state consists of misinforma- 
tion or even inaccessible information. 

DR. BUTLER: This is a somewhat dif- 
ferent kind of remark occasioned by some- 
thing that Dr. Haggard said. He said yes- 
terday that if you are looking at a correla- 
tion chart and find low correlations, the 
data bringing about the low correlations 
are very often lawful. You find things off 
the regression line in bunches and clumps, 
and this leads to new hypotheses about 
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what went on. You find in such cases that 
there is a basic kind of correlation and 
something throws it terribly off: the 
original basic hypotheses weren't wrong 
but they weren't enough, and that is one 
of the implications of your remarks. This 
seems to apply to our discussion of anxiety 
here. As much as I am discontented with 
this kind of situation, I am also discon- 
tented that we all feel that anxiety is con- 
nected with the self -limited and inhibiting 
mechanisms, and yet it is a complicated 
topic and central to the psychotherapeutic 
process. If we looked at all these different 
ways as opportunities in a sense, most of 
them have some reality. That is, the 
Taylor Anxiety Scale, a much-blamed in- 
strument, yields fairly consistent results in 
many situations. At just the point where 
it doesn't work out we have a research 
opportunity. At Wisconsin they found 
that if you have all sorts of indicators 
wired, literally speaking, to the patient, 
and if the therapist is groping for a 
phrase, the anxiety indicators go way up 
during the silence. This probably does not 
correlate with the Taylor scale but ob- 
viously it is a momentary fear that the 
therapist is going to say something dam- 
aging to the self-esteem of the patient. 

It seems to me that all these different 
formulations have been fruitful in one 
way or another, and they show both the 
complexities of the situation and the valid 
ways in which we are able to look at this 
whole complex group of phenomena that 
we call anxiety. It seems to me that if we 
follow systematically these different ideas 
through, as well as pressing for unitary 
definitions which are satisfactory, we will 
have the opportunity of running these dis- 
j unctures head on into each other. Here is 
just the point where we have not only a 
new researchable problem but also the 
point at which we are likely to get new 
information and change of ideas rather 
than decide which definitions of anxiety, 
for example, are the best. I think this ex- 



ample that Dr. Haggard mentioned yester- 
day could apply to our concepts of anxiety. 
Most of them seem to me to be pretty 
good in the sense that relationships with 
the therapy process, with critical incidents 
in therapy, etc. have been found with 
nearly all of these instruments, which very 
often correlate negatively with each other. 
Very often we have not even looked at the 
scatter plots. 

DR. HUNT: Apropos of Dr. Butler's 
remarks, we were very much disappointed 
at first when the Taylor Manifest Anxiety 
Scale failed to correlate with such meas- 
ures of anxiety as palmar sweat measured 
colorimetrically with impressions on pa- 
per impregnated with ferric chloride. In 
the work of one of my students, 3 scores on 
the Taylor scale correlated with neither of 
the palmar sweat levels, nor with the de- 
gree to which his subjects showed an in- 
crease in palmar sweat between measures 
made some weeks away from the date of 
their doctoral examinations or of opening 
night of a play in which they were acting, 
and measures taken the day before the 
doctoral examinations or the afternoon of 
"opening night." There were methodolog- 
ical problems in the Beam study, however, 
and only recently have we got the proper 
kind of situation in which to test the 
relationship between palmar sweat and 
such inventory measures of anxiety. Carl 
Haywood, another of my students, has 
arranged a standard situation in which he 
feeds his subjects a message which con- 
tains a disconcerting conglomeration of 
information. When palmar sweat is meas- 
ured before and immediately after this 
message, it shows an increase. Moreover, 
when an instrument very much like the 
Taylor scale is used, this instrument pre- 
dicts fairly well the degree of change in 
palmar sweat that occurs in this situation. 

DR. BORDIN: I guess this discussion 



3 Beam, J. C. Serial learning and condition- 
ing under real-life stress. /. abnorm. soc. 
PsychoL, 1955, 51, 543-551. 
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moves me to propose another category of 
anxiety, namely, scientific anxiety. I am 
more than flippant about it; I am serious 
about it. As we talk we must combine 
data language (behavior language) with 
concept language. Collectively, we intro- 
duce a wide variety of observations as 
well as a wide variety of concepts. In- 
evitably, anyone faced with this kind of a 
complex cognitive field must respond with 
some effort to simplify it. In fact, my im- 
pression is that the progress in knowledge 
follows exactly that form. Some of the 
data language proves peripheral and gets 
dropped as repetitive. I think this is what 
Dr. Jack Block was talking to the re- 
dundance of some concepts. Our concept 
language proves peripheral as well as 
redundant. We go through a cycle similar 
to that with regard to data language, drop- 
ping certain kinds of concept language, of 
recombining and structuring and simpli- 
fying it. I have the impression that there 
is no substitute for this kind of cycle as 
long as we are clear as to just what the 
ingredients of the cycle are. We must 
avoid mixing our data language and our 
concept language with a resulting confu- 
sion that obscures this cycle that scientific 
enterprise entails and that may lead to 
something that does not make us even 
more anxious as scientists. 

DR. PARLOFF: I wonder if it would 
be appropriate now to return to the ques- 
tion that was asked earlier by Dr. Strupp. 
Do you recall the question, which was 
about criteria whether one should use 
intratherapy criteria, therapist's ratings, or 
external measures of the outcome of 
therapy? 

DR. STEVENSON: I have been very 
uncomfortable since Dr. Strupp asked that 
question. I had not forgotten it and felt 
that if there was a pause I would try to 
discuss it. I think we did not reach any 
firm opinions on the best criteria of meas- 
uring change, and a short answer to Dr. 
Strupp probably would be that all three 



of these measures are important and 
should be used and compared with each 
other. At the same time we should recog- 
nize that the simplest one to ask the 
patient how he is before and after treat- 
ment is the least valuable; the most im- 
portant one the judgments of other peo- 
ple about the patient's behavior and 
changes is the most difficult to attain. 
So we are probably going to have to try 
to develop all three of these methods of 
measuring. 

DR. SHLIEN: Sooner or later this job 
is going to have to be done, and I think 
there is a common recognition among us 
that it will be done and the comment on 
the scientific anxiety is one recognition 
of that. 

Just let me propose that I think this 
will be the image of events shortly, so 
why not put it into action instead of let- 
ting \t fall upon us* Let there be a com- 
mittee of astute and honorable men who 
spend the next five years providing us 
with one criterion in each of these cate- 
gories so that we can have comparability 
amongst all our studies and still allow 
measurements regarding individual inter- 
ests of the researcher. Let me just state my 
bias: I hope you will give us measures 
which concentrate on the measurement of 
strength this is what I have been saying 
all through the conference. I think it is 
the essential thing to measure. I really 
wish Dr. Saslow would comment on some 
of the remarks he was making to me yes- 
terday regarding concepts of health as 
more than residual, or the absence of dis- 
ease. I do not know whether you are going 
to take that up. If so, I would like to see 
that thrown in as a line of thought, 

DR. SASLOW: I wasn't clear what 
kind of committee you wanted to set up. 

DR. SHLIEN: The kind of committee 
that is composed of astute and honorable 
men. I think it will have to be both of 
those things. I do not know how the com- 
mittees operate or are selected, but isn't 
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it the obligation of this conference and 
the responsibility of this kind of confer- 
ence to move in that direction? 

DR. HUNT: Although I recognize that 
fruitful research on psychotherapy de- 
mands organization, that it demands even 
complex organization, I am troubled by 
Dr. Shlien's suggestion for a coordinating 
committee, no matter how astute and 
honorable the men composing it might be. 
I am troubled because this looks like an 
attempt to give away our freedom, our 
freedom to investigate our own hy- 
potheses. The suggestion reminds me of 
that play by Archibald MacLeish which is 
titled, I believe, The Land of the Free. In 
it, he has the line, according to my now 
dim recollection, "They cannot stand their 
freedom." My point is this: I believe we 
cannot force even research development 
by artificial organization of committee 
structures. The research we see needed 
will have to come by a growth process in 
which each of us will contribute, with our 
own groups, as we investigate our own 
hypotheses in our own way. Gradually, 
there may come a time if psychotherapy 
as we now see it continues to be consid- 
ered important when a major center is 
created to investigate the kinds of issues 
we cannot investigate via small individual 
enterprise. I suspect that each of us, in his 
own way, will grow beyond the kind of 
things that Dr. Bordin has been talking 
about. Yet I agree thoroughly that we 
must get outside of our psychotherapeutic 
offices in the search for criteria of client 
or patient change. This, however, need 
not call for a coordinating committee. 

DR. BOLGAR: It seems to me that the 
definition of criteria is closely related to 
the purpose of therapy and the specific 
stance a therapist takes concerning his 
goals and the patient's goals. If psycho- 
therapy is essentially a process of "curing 
the sick," the criteria would inevitably be 
selected in terms of reducing illness. If, on 
the other hand, therapy is viewed as an 



experience of growth in and through an 
interpersonal relationship, then we will 
have to look for criteria of growth, and 
the changes will have to be measured in 
entirely different ways. In our own study 
we are developing two sets of criteria 
which may overlap at some points. I sus- 
pect that both sets measure changes in 
growth rather than in reduction of illness. 
One set of criteria deals with the changes 
in tolerance for anixety, for ambiguity, 
for complexity, for uncertainty. The other 
set of criteria is based on Erikson's think- 
ing about growth and development. We 
have tried to construct a Q sort utilizing 
Erikson's illustrations of the "eight stages 
of man." We have put concepts like iden- 
tity, intimacy, integrity, as well as those 
of the preadolescent conflicts into first 
person descriptive terms of interpersonal 
and intrapersonal experiences. While 
these two sets of criteria may not tap all 
the possible outcomes of psychotherapy, 
we find them useful for our long-term 
psychoanalytic psychotherapy cases. Prob- 
ably there are no universal criteria which 
could be applied to all forms of thera- 
peutic experience. 

DR. SHAKOW: In line with Dr. 
Shlien's comments and the remark of Dr. 
Bordin, it certainly seems within the 
province of a conference of this kind to 
take stock of the present status of the field 
and to make recommendations of any kind 
that it wants to make. If the group feels 
at the present time that a committee such 
as Dr. Shlien suggested or some confer- 
ence such as Dr. Bordin suggested would 
be profitable, there are agencies to take 
care of this. For instance, the Social Sci- 
ence Research Council has committees of 
various kinds which take responsibility 
for certain areas. I do not see why psycho- 
therapy should not be one of these areas. 
A committee of this kind could be set up 
through the Social Science Research Coun- 
cil The Council has obtained funds to 
support summer conferences, small con- 
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ferences, or short conferences as well. I 
had hoped that something of this kind 
would come out as recommendations of a 
conference of this kind. Perhaps Dr. Saslow 
was hoping to get into this in his conclud- 
ing remarks. We could continue with 
these three-day conferences for many, 
many years. The question is how much 
further they advance us. Perhaps we are 
ready for more rapid advance than we 
have been making, and this could be ac- 
complished by other devices. 

DR. BUTLER: I certainly would want 
to second this, although I am not sure this 
is the appropriate point. 

For example, it occurs to me that in our 
studies of psychotherapy, from pretherapy 
to follow-up periods, of whatever duration 
they are, we are really short of the mark. 
We cannot do in 20 years what a man 
with a program of studies working with 
animals can do in two or three years. Let 
me give you an example from my own 
experience which I think seriously limits 
our knowledge. 

In doing a study some years ago at the 
Counseling Center, which was reported 
by Rogers and Dymond, we found that 
certain of the clients terminated therapy 
because they moved away. Certain clients 
terminated therapy because therapy was 
over, they thought, and the therapist so 
thought. Certain clients terminated thera- 
py because they thought they were 
through and the therapist didn't. Because 
of limitation of time and money we had 
to consider all of these people as having 
terminated therapy. However, the results 
were differential, and it is very clear that 
if we had taken the people who termi- 
nated therapy when the therapist and the 
client had agreed that therapy was over 
we had a large number of such clients, say 
25 the results would have been much 
more clear-cut, much more consistent, and 
so on. We arbitrarily defined our clients 
as being in the same stage of the process 



when, actually, they were in entirely dif- 
ferent stages of the process. 

I would suggest seriously that studies of 
psychotherapy require at least ten-year 
spans, and that a program should be 
allowed to run for ten years even for a 
relatively modest sample. Now, this might 
be costly. A good strategy might be small 
yearly grants. 

DR. HUNT: While I was at the Insti- 
tute of Welfare Research of the Com- 
munity Service Society of New York, we 
had a sample of 38 cases that we used 
continually in the development of our 
Movement Scale. 4 We also followed those 
cases up. The follow-up interviews were 
made between five and seven years after 
the cases were closed. It was an amazing 
experience. Parenthetically, I should call 
attention to the fact that in family case- 
work, a case is a family rather than an 
individual, and that there were 130-some 
individuals comprising these 38 cases. In 
our follow-up study, Phyllis Bartelme 
found the individuals in these 38 cases 
all over the country. She found some in 
California, some in New Orleans, some in 
Virginia, some in Chicago, others in 
Detroit. We made the effort and suc- 
ceeded in seeing nearly all the individuals 
in all of these cases. We demonstrated 
that it can be done. It certainly takes the 
investigator outside the office. Moreover, 
it was very expensive; that study cost in 
the neighborhood of $60,000. 5 

DR. SASLOW: I would like to speak 
a little bit to what Dr. Shlien said. It 
makes a good deal of difference what 
point of view you take about your goal in 
dealing with a client or patient. As Dr. 

4 Hunt, J. McV., & Kogan, L S. Measuring 
results in social casework: A manual on judg- 
ing movement. New York: Family Service 
Association of America, 1950. 

5 Kogan, L. S., Hunt, J. McV., & Bartelme, 
Phyllis. A follow-up study of the effects of 
social casework. New York: Family Service 
Association of America, 1953. 



GROUP DISCUSSION: MEASURING PERSONALITY CHANGE 



281 



Bolgar has said, I think one works very 
differently if you think as the conven- 
tionally trained doctor does that his goal 
is curing the sick or helping the sick 
than when the viewpoint is that if a per- 
son has come to you for some kind of 
psychological help, then whatever his pre- 
senting symptoms, incapacities, difficul- 
ties, complaints, or the stress he causes 
others, your goal is to discover what kind 
of person this could be. In the ktter case, 
you often find, as you help him examine 
his life and help him choose new pur- 
poses, that his presenting difficulties are 
matters en passant. For this reason I find 
most stimulating George Kelly's way of 
looking at the goals of psychotherapy in 
his book The Psychology of Personal Con- 
structs. He regards psychotherapy not as 
having to meet the criteria of reducing 
discomfort, abolishing or minimizing 
symptoms, etc., but rather as helping the 
person learn by a variety of methods that 
he need not be a prisoner either of his 
biography or of his situation. He con- 
siders the goal of psychotherapy to be 
helping the person learn this. When he 
thinks a person has learned this, he is not 
particularly interested in counting the 
number of persons who apply their eman- 
cipation in this way, the number who 
apply it in some other way, etc. Kelly, 
like me, has no commitment whatever to 
what kind of life the patient then chooses. 
In a sense he regards him as having 
broken out of a circular fence once out, 
he is free. My experience has been that 
this attitude is far more powerful than the 
conventional doctor's attitude. Whatever 
disabilities a patient has brought to me 
initially, whether they are symptoms in 
the conventional physiological sense or 
behavior disabilities, I make the assump- 
tion that the likelihood that they will 
develop zero strength is probably zero, but 
that the role these disabilities will play, 

Kelly, G. A. Th$ psychology of personal 
constructs. New York: W. W. Norton, 1955. 



subsequently, if he has been freed from 
his past and his situation in Kelly's sense, 
becomes entirely bearable, acceptable, 
often very understandable, and very much 
less preoccupying and determining than 
before. Thinking of the psychotherapeutic 
process in this way takes you away from 
some of the issues we have been talking 
about, for one thing, and for another allies 
you in your psychotherapeutic activities 
with many other people who study the 
socialization, the education, the growing 
process of persons not referred to you for 
consultation. To this way of regarding 
psychotherapy, Dr. Levinson's approach is 
most congenial: the psychotherapist looks 
at the problems of his patient as if he 
were examining a career. I find to my 
surprise that although he and I have never 
talked to each other about our views of 
psychotherapy, his paper about regarding 
the patient as having a career has funda- 
mental similarities to the principles I used 
four years ago in designing a psychiatric 
ward on which patients live, are studied, 
work on their problems (with their fami- 
lies if necessary), as if we are concerned 
chiefly with their careers. 

DR. BORDIN: I want to respond to 
Dr. Saslow's comments about people 
being caught in traps by referring to the 
purposes of a conference like this, or a 
summer conference, or any exchange be- 
tween research workers. I would see its 
major purpose being to free us of the 
traps we are caught in by our own con- 
cepts and our own measures of behavioral 
variables. I think that a conference like 
this one is too brief to permit this kind of 
process to take place. We made some 
starts on it in our small groups. I know 
that through my interactions with others 
a start was made at releasing me from the 
traps I was caught in. For this reason I 
appeal for a more extended conference, 
one in which this kind of dialectic can 
take place and in which there is some 
opportunity for us to find out how much 
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we must give up of our cherished assump- 
tions in order to escape our traps. This is 
why I respond very much to Dr. Shakow's 
suggestion that we need to set in motion 
some more extended process of exchange, 
one that endures long enough to permit 
deeper communication. 

DR. SASLOW: I wanted to add in rela- 
tion to the concept we were just discussing 
a very interesting set of observations pre- 
sented at Chicago at the American Psychi- 
atric Association meeting. It concerned the 
criteria used for studying 50 adult men, 
labeled 50 normal men, defined as normal 
because they scored (on various scales) 
within one standard deviation from the 
mean on the MMPI (Minnesota Multi- 
phasic Personality Inventory). When 
these youngsters were boys of nine or so, 
there was a study at Minnesota, a total 
sample of school children of a particular 
grade. A certain number of years later 
these adults have now been followed up, 
using some of the original methods of the 
research group. They followed them into 
their homes; they talked to their wives 
and about their occupations, and learned 
a great deal about them. The observers 
reached the conclusion that if your initial 
criterion was that a normal person is one 
who scored within plus or minus one 
standard deviation on the MMPI you 
found that you had in adulthood a com- 
placent group of fellows who were a kind 
of caricature of American life: very 
happy, their wives thought they were 
wonderful, their kids loved to go to school, 
they had a house, and they had a car, but 
they were shockingly lacking in imagina- 
tiveness and creativeness, Wesley and Ep- 
stein, who are conducting a study on what 
they call normal students at McGill in 
Canada, have used quite different criteria 
of normality. In commenting on the 
American study, they were surprised that 
anyone would think of the MMPI score 
as described above as a criterion for nor- 
malcy. They clearly included in their own 
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acknowledgment of what a healthy func- 
tioning human being is, someone who has 
unresolved tensions of various kinds, has 
unresolved aspirations, or ego enhancing 
models, and so on, a very different and 
much more dynamic concept. This struck 
me as relevant to what I find myself 
caught up with over and over again in a 
medical setting. Although there are many 
ways in which we find the analogy of psy- 
chotherapy with medicine very useful, 
here is one of the traps we may fall into: 
curing the sick always seems to be closely 
related to exorcising demons or patho- 
genic agents, with the hoped-for result 
that the organism so afflicted with a short- 
term kind of process will then be ready to 
revert to the status quo ante illness or dis- 
ability. I think a great many psychiatric 
problems cannot be dealt with effectively 
in terms of that concept. Our problems in 
general have more to do with the long- 
term quality of a human life which will 
have a duration of 80 to 100 years. 

DR. SHLIEN: Dr. Bolgar says that 
there are two therapeutic orientations. Let 
us test the truth of that. Are there really 
those primarily interested in curing, and 
those primarily interested in growth? We 
do seem to have divided in terms of what 
we measure some measure anxiety, pres- 
ent at the beginning of therapy, absent at 
the end while others may focus on "self- 
esteem" absent at the beginning, present 
at the end. Would the first group be ac- 
curately identified as "curing" and the sec- 
ond as "growth" oriented? Do we really 
divide on orientations this way? 

DR. BLOCH: Much of this discussion 
points to the desirability of having certain 
classes of persons as part of this confer- 
ence group. The philosophical anthropolo- 
gists, for example, certainly belong here 
if we can find any such who would be con- 
genial to coming, and those sociologists 
who speak to the issue of what kind of 
social phenomena we are also ought to be 
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here. We need to be in context in addition 
to having the patient in context, and 
should recognize the relationship between 
our purposes and the society's purposes for 
us. It bears on the kind of research that is 
generated. Perhaps some disagreement 
would be resolved if we could understand 
more clearly our relationship to the social 
and philosophical context in which we as 
therapists or researchers operate. 

DR. KRASNER: I want to comment 
on something that Dr. Butler said, but 
first I want to second with whole-hearted 
agreement what Dr. Bloch has said. Dr. 
Butler suggested the need for long-range 
10-year studies of psychotherapy. "While I 
agree with the need for such long-range 
studies, there are a large number of ques- 
tions that this conference has generated 
that can be answered in shorter periods of 
time in so-called laboratory settings. Thus, 
I would give one additional job to this 
committee, to ask the kinds of questions 
that can be answered in laboratory settings 
and to explore the implications of the so- 
called laboratory studies for the long-term 
psychotherapy process. 

DR. BUTLER: I would hope that lead- 
ing from there would be some kind of 
interaction to find out what grows out of 
psychotherapy. We have not been in the 
office as much as we say we have, except 
as therapists. In fact we have been in the 
office very little as therapists; as research- 
ers we have not been. Show me more than 



a very small handful of satisfactory process 
therapy studies! Now, if we can well de- 
scribe the process, we can well theorize 
about it. We have more realistic oppor- 
tunity for just the kind of interactions you 
propose. 

DR. HAMBURG: The discussion of 
the last half hour or so I think reflects a 
rather widespread concern in the mental 
health field, particularly among those in- 
terested in criteria of mental health in a 
more positive sense than the absence of 
gross mental illness. It is reflected in pub- 
lications in recent years by Erikson, Ja- 
hoda, Scott, Hartmann, and others. While 
I am personally sympathetic to these ap- 
proaches, I have been very much im- 
pressed with the difficulties involved. One 
of the most formidable difficulties, it 
seems to me, could be briefly stated, 
"Whose values?" This raises a question, 
which may have been discussed in some 
of the subgroups about the bases for 
evaluation of change in therapy. Here, as 
Dr. Bloch has suggested, we get into some 
of the fundamental questions of the social 
sciences, and I think it would be very im- 
portant to consider these problems with 
the help of anthropologists and other 
social scientists. One way in which this 
second psychotherapy conference seems to 
me to have made a significant advance 
over the first conference is in its greater 
recognition of social factors. I believe we 
could go even further in future meetings. 
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Dr. Shakow, our chairman, opened our 
meeting with the suggestion that we at- 
tempt to define the topic or topics we 
wished to concentrate on in order to limit 
the scope of our discussion. In looking 
over my notes, I suspect that, instead, we 
adopted the working assumption that if 
we could get enough variables into orbit 
we could establish our own universe of 
discourse. 

After obtaining a blackboard, we listed 
a variety of proposed topics, out of which 
we hoped to select a few for intensive dis- 
cussion. At this stage we set only one re- 
striction on ourselves namely, that the 
topics should have to do with some form 
of therapist-patient interaction. In order 
to give you an idea of how this phase of 
our discussion went, I will list the sug- 
gested topics as they were proposed. The 
list includes: 

( 1 ) The dependency of the patient on 
the therapist and the therapist's commit- 
ment to support and nurture the patient 
in therapy. 

(2) The relative congruence of the 
therapist's and the patient's value systems 
and, more generally, their view of the 
nature of man (e.g., a bundle of operant 
responses or a superstructure built on a 
fluid unconscious). 

(3) The relation of intratherapy inter- 
actions and processes to behavior in non- 
therapy situations (e.g., what does the 
patient talk about and deal with in therapy 
and how does he live and act in the out- 
side world). 

(4) The extent to which the therapist 
makes his goals and values known to the 



patient and their effect on the patient's 
behavior in and out of therapy. 

(5) The effects of different levels of 
anxiety in the therapist and in the patient, 
with primary reference to the problem of 
establishing and maintaining some op- 
timal level of anxiety. 

(6) The nature and generality of the 
working contract between the therapist 
and the patient, with particular reference 
to their activity levels during therapy. 

(7) The effects of the therapist's vary- 
ing his own roles and goals on the therapy 
process (e.g., the therapist's shift from the 
role of helper to that of investigator) . 

(8) The degree of communicational 
efficiency between the therapist and the 
patient, including both the substantive 
content and the affective aspects of their 
communications. 

At this point, the blackboard was filled, 
and I think we were all relieved that it 
was not a larger one. 

Since we had run out of space for any 
more topics-at-random, Dr. Shakow then 
suggested that we attempt to work from 
our first list of suggestions toward a 
shorter list of topics, again with emphasis 
on therapist-patient interaction variables. 
On this go-around, there were four topics 
or areas suggested. They were; 

( 1 ) The degree of structuredness in the 
therapy situation, that is, the extent to 
which the situation and all its dimensions 
are structured or allowed to remain unde- 
fined and ambiguous. 

(2) The definition of the therapist: his 
tasks, goals, how he presents himself as a 
person to the patient and his view of the 
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patient, and, correspondingly, the patient's 
view of the therapist and of himself, of 
the therapeutic task and of his participa- 
tion in it, and the effect that such factors 
might have on the therapeutic process. 

(3) Variations in anxiety level (espe- 
cially the patient's) with particular refer- 
ence to differences between acute and 
chronic anxiety, such as a temporary 
anxiety attack as opposed to a chronic 
obsessional or psychotic state. 

(4) The problem of transference and 
the patient's perception of himself. 

Although the reduced list of topics was 
drawn up to focalize our discussion, it can 
hardly be said that we were intimidated 
by the list and, like most any other group, 
our discussions splashed over from time 
to time into an assortment of other topics. 
But I will try to summarize the sense of 
our discussions by following two threads: 
one was concerned essentially with clinical 
content and theory and the other with 
methodological aspects of the psycho- 
therapy process. 

Most of the discussion during the 
morning session focused around consid- 
erations of what we may call the "con- 
tinuum of ambiguity structuredness." 
Broadly speaking, this continuum has to 
do with the extent to which various fac- 
tors or characteristics of the therapy situa- 
tion as a whole tend to maximize or mini- 
mize the range of the therapist's and the 
patient's behavior. We discussed at least 
five aspects of this continuum which can 
be thought of as variables or dimensions 
along which there can be degrees of am- 
biguity or structuredness. 

The first dimension has to do with the 
nature of the therapeutic task. One could, 
for example, be either quite specific or 
quite ambiguous about what is to be done, 
as to free associate or to discuss current 
life problems, or to give the patient free- 
dom to discuss whatever he likes. The 
second dimension has to do with the 
nature of the required or acceptable con- 



tent to be given by the patient. Although 
similar to the first, this dimension has to 
do with the extent to which the patient is 
free to discuss different types of content, 
whether it be, for example, past or pres- 
ent sexual and aggressive impulses, inter- 
personal relationships, feelings, fantasies, 
or current reality experiences. The third 
dimension has to do with the therapist- 
patient relationship. Thus, the therapist 
could fix and maintain a particular rela- 
tionship (e.g., seemingly impersonal or 
personally involved in the patient's prob- 
lems) or he could allow the relationship 
to vary over the course of therapy, de- 
pending on such factors as variations in the 
patient's anxiety level, the content being 
dealt with, or the occurrence of significant 
external events in the life of the patient. 
The fourth dimension has to do specific- 
ally with anxiety level especially of the 
patient, but also of the therapist to some 
extent. In this case, the therapist might 
permit or even facilitate variations in the 
patient's anxiety level or he might try to 
maintain some fixed or optimal level of 
anxiety, as defined in terms of various 
other characteristics of the situation or 
his goals for the therapy. And, finally, the 
fifth dimension has to do with the relative 
activity or passivity of the therapist and/or 
patient. For example, the therapist might 
define for himself and the patient a rela- 
tively active or passive role in the therapy 
situation, and in addition might attempt 
to maintain such a level of activity over 
the course of therapy or might attempt to 
vary it during particular phases of the 
therapy. 

There were also, of course, a number of 
examples which suggested possible effects 
of variations in the degree of ambiguity or 
structuredness in the therapy situation. 
For instance, with increased ambiguity 
(or decreased structure) the patient is not 
only freed to behave in a greater variety 
of ways, but the ambiguity also permits 
such phenomena as transference to emerge 
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and flourish. As in the use of projective 
techniques where one presents the subject 
with an ambiguous (rather than well- 
defined) stimulus, the subject is both per- 
mitted and required to bring structure to 
it, to add characteristics of himself by 
"projections" from his own attitudes and 
experiences. In some types of therapy, 
such as psychoanalysis, a condition of rela- 
tively great ambiguity similarly permits if 
not requires the patient to fill in impor- 
tant aspects of the situation which are not 
made explicit by the therapist. And, since 
to the patient the therapist is perhaps the 
most important aspect of the therapy 
situation, and since a large component of 
therapy has to do with emotional reac- 
tions, it is not surprising that the patient's 
view of the therapist, of his interests, his 
likes and dislikes, and of what he approves 
and disapproves will be in large measure 
a projection or transference based on the 
patient's own character, experience, and 
affects. If, on the other hand, the therapy 
situation is well defined, vis vis, and the 
therapist is active and explicit in respond- 
ing to the patient, one would expect any 
transference phenomena to be less intense 
and pervasive. 

We also discussed, of course, various 
types of styles of therapy, and in so doing 
we made use of the usual oversimplifica- 
tions of such men as Freud, Rogers, and 
Sullivan in comparing different degrees 
and types of therapist-patient interaction 
and their probable effects on the material 
presented by the patient. We hypothesized, 
for example, that if the therapist is vis 
vis the patient and is highly responsive to 
him, the patient will be apt to deal pri- 
marily with his "conscious" reactions to 
his current life experiences and interper- 
sonal relationships. However, under con- 
ditions where the therapist is removed 
from the patient's view, and remains rela- 
tively unresponsive, it was suggested that 
the patient would be more apt to deal 
with his "unconscious" reactions to pre- 
experiences and 
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interpersonal relationships. In this con- 
nection, it appears that Freud proposed 
that therapy should be conducted under 
conditions of relative "sensory depriva- 
tion," in the sense that active sensory 
stimuli, whether proprioceptive or visual, 
should be reduced by having the patient 
He quietly on a couch with the therapist 
removed from his view. And, as in the 
more recent and radical "sensory depriva- 
tion" experiments, the relative removal of 
sensory stimuli seems also to remove the 
glue that holds men firmly to a sense of 
current reality. 

Another line of discussion had to do 
with the extent of the therapist's respon- 
siveness and whether he responds differ- 
entially to different types of material, as 
they might affect what the patient will be 
inclined to deal with over the course of 
the therapy. Thus, the more the therapist 
uses a sort of conditioning technique, or 
(in terms more acceptable to some thera- 
pists) becomes actively involved in the 
interchange by showing interest in certain 
types of material, or by making interpre- 
tations of the material to the patient, the 
more he will tend to control and restrict 
the flexibility and range of what the pa- 
tient talks about since the patient will 
tend to talk about what he thinks will 
interest the therapist. Or, on the other 
hand, the more the therapist is noncom- 
mittal and responds permissively to all 
types of material, the more freedom the 
patient will have to discuss a broad range 
of topics or experiences, and the more he 
will tend to do so. 

Along with our theorizing, a number of 
clinical examples were given in support 
of, or as qualifications to, our discussion 
of the various topics. For instance, Dr. 
Will indicated how a therapist might start 
the treatment under conditions of rela- 
tively clear structure and later increase 
ambiguity as the therapy progresses. In 
working with a disturbed patient, for ex- 
ample, he initially defined the therapeutic 
task rather specifically and restricted the 
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patient to a few areas which, he felt, could 
be dealt with at the time. Later, as the 
patient's ego strength grew in therapy, he 
increased the ambiguity to permit the 
patient greater freedom to deal with a 
wider range of affects and experiences. 
The reverse trend also occurs, especially in 
psychoanalysis, as when the patient be- 
comes too anxious or begins to show signs 
of pathology during a particular phase of 
the therapy. Under such conditions, the 
therapist may ask the patient to sit up 
until the disrupting anxiety is worked 
through, and after the patient has regained 
control will allow him to return to the 
couch. 

In summarizing this aspect of our dis- 
cussion, we speculated about ways in 
which the therapist is able to exert con- 
trol over the therapeutic process, includ- 
ing the productions of the patient, by 
manipulating the degree of ambiguity or 
structuredness in terms of, for example, 
the nature of the therapeutic task, the 
nature of the therapist-patient relation- 
ship, or the nature and range of the ac- 
ceptable content to be given by the patient. 
In some instances this could be done by 
controlling the more specific components 
of the therapeutic situation, such as the 
level of activity or anxiety. 

I mentioned earlier that there were two 
main threads that ran through our discus- 
sion: clinical content and theory on the 
one hand and research methodology on 
the other. From time to time, studies were 
cited which had to do with one or another 
aspect of ambiguity or structuredness in 
therapeutic situations. For example, Dr. 
Bordin cited studies by two of his stu- 
dents, 1 who found chat raters showed a 
high degree of agreement in judging the 

1 Osburn, H. G. An investigation of the am- 
biguity dimension of counselor behavior. Un- 
published doctoral dissertation, University of 
Michigan, 1951. 

Townsend, A. H. An empirical measure of 
ambiguity in the context of psychotherapy. 
Mich. Acetd. Science, Arts & Letters, 1956, 41, 
349-355. 



relative ambiguity of the therapist's state- 
ments specifically, the extent to which 
statements by the therapist were expected 
to (and in fact did) maximize or mini- 
mize the range of responses that the pa- 
tient could give. Using a sample of pro- 
tocols from 30 therapy hours, the findings 
of these investigators held up regardless of 
whether the ratings were based on specific 
topical segments in the hour or on the 
hour as a whole. 

In another example, Dr. Lennard re- 
ported findings 2 regarding the effects that 
differing degrees of ambiguity or struc- 
turedness tend to have on the nature of 
the therapist-patient interchange. In rating 
the therapist's statements, he used an 
eight-point scale from most ambiguous, 
such as "Tell me more" or "Continue" 
through increased structure such as "Tell 
me more about . . ." to the most structured, 
which was, "Let's not talk any more about 
that right now." He found that with in- 
creased ambiguity in the therapist's state- 
ments, the patients tended to talk more, to 
cover a wider variety of topics, and to 
change the direction of their remarks 
more often than when the therapist's pre- 
ceding statement was highly structured. 
He also found that, after the patient had 
been silent for a period of 10 seconds or 
more, the therapist's statements tended to 
be highly structured, such as 'Tell me 
more about . . . ," rather than, say, "Please 
continue." 

Finally, Dr. Butler reported a study in- 
vestigating changes in the cognitive struc- 
ture of patients over the course of therapy, 
with particular reference to changes in 
their view of the significant persons in 
their life. He found at the beginning of 
therapy that patients frequently protested 
excessively positive views of themselves 
and negative views of others, such as "I 
arn good; it is they who are at fault." As 

2 Lennard, H. L., & Bernstein, A. The anat- 
omy of psychotherapy: Systems of communica- 
tion and expectation. New York: Columbia 
Univer. Press, I960. Pp. 131-153. 
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therapy progressed, their tune often 
changed to, for example, "Honestly, I am 
not such a good guy after all and they 
have some good points too." And, by the 
end of therapy, the patients character- 
istically tended to show more subtle and 
realistic appreciations of themselves, of 
the others, and of their interactions with 
them. 

In citing examples of research studies 
which bear on some of the concomitant 
effects of relative ambiguity or structured- 
ness in the therapy situation, I have se- 
lected examples to illustrate the role of 
this variable with respect to the thera- 
pist's statements, to the therapist-patient 
interchange, and to changes in the patient 
during therapy. There were others, of 
course, but these three will suffice to indi- 
cate the nature of our thinking with re- 
spect to this variable. 

Now, my time is up. In closing, I want 
to say that in summarizing our discussion, 
I have taken a few liberties by occa- 
sionally abstracting or generalizing, add- 



ing to or taking from what was said ex- 
plicitly but I hope that the other 
members of our group will recognize the 
content of my report as being at least im- 
plicit in our discussion of yesterday morn- 
ing. I also want to add two brief personal 
comments, one of which has already been 
made by Dr. Hamburg. It is that, by the 
end of the day, we felt we were sufficiently 
acquainted and ready to settle down to 
hard work, that we were on the threshold 
of making progress in grappling with a 
number of points that we had touched 
upon earlier in the day. In other words, 
we ended the day wishing that we could 
have continued our discussion. The other 
point has to do with the composition of 
our group specifically, the inclusion of 
clinical and research persons. I was par- 
ticularly impressed by a sensitivity to the 
integrity of the clinical situation balanced 
by an active interest in investigating the 
nature of the clinical or therapeutic situa- 
tion. The fact that we were able to main- 
tain this balance was one of the most 
satisfying aspects of our discussion. 
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I have arranged the rest of our discus- 
sion under three topics. One of them was 
introduced by Dr. Butler under the title 
of activity level, and I think was incor- 
porated in the first factor of the analysis 
reported in his paper. This appeared as an 
expressiveness factor, and as we talked 
about it, it began to have other character- 
istics. It seemed to reflect the therapist's 
interest in the patient, the therapist's 
caring for the patient. Some of us gave 
other terms to it, such as the therapist's 
spontaneity, his effort to understand the 
patient. As Dr. Butler described it, it had 
in part the character of the therapist set- 
ting himself, by his posture and so on, so 
that all senses were directed toward the 
patient. The other element had to do more 
with the therapist's freedom to express 
himself. It was captured in the vividness 
that he imparted to his communication 
through bodily movement, through ges- 
tures, as well as by the choice of his 
language, the imagery of his language, 
and so on. Here is a variable that differ- 
entiates therapists. In trying to see where 
it fits into psychotherapy, we discussed 
such notions as that this characteristic was 
a basic ingredient in making a communi- 
cation process effective. Somehow this 
stimulating characteristic of the therapist 
(vividness of communication) activated 
the patient's capacity to receive the thera- 
pist's message and to some extent perhaps 
increased the capacity of the two persons 
to communicate with each other. Dr. 
Butler reported some studies I think 
they arc unpublished studies at Chicago 
in which successful cases of experienced 
therapists were characterized by the thera- 



pist working with a patient who was at a 
lower level of expressiveness to begin 
with, and where the therapist was at a 
high level of expressiveness, but as therapy 
progressed the patient was brought up to 
a comparable level with the therapist. 
With the inexperienced therapists, their 
successful cases were patients who hap- 
pened to be at the same level of expres- 
siveness as their therapists, and this was 
at a somewhat higher level. The inexperi- 
enced therapists as a whole tended to 
establish their level of expressiveness at 
the level at which the patient was, and the 
unsuccessful cases with the inexperienced 
therapists were those where the level was 
low in both participants. 

There was some attempt to rationalize 
the significance of this variable in terms 
of saying, particularly in neurotic difficul- 
ties, that the individual is unable to be 
expressive as a function of anxiety. The 
therapist by being so helps the patient to 
learn to break away from this anxiety, to 
overcome it, and to become expressive. 
Dr. Butler told us of experiences in train- 
ing students to do therapy in which they 
taught the students how to be more ex- 
pressive and where this seemed to have 
an important impact as compared to other 
ways of training students. They felt they 
got much better progress toward master- 
ing therapeutic skills. The training in- 
volved partly talking about this issue of 
expressiveness; apparently this was a de- 
parture from previous training methods 
where the main emphasis was more on 
the prohibitions toward action rather than 
giving the student a particular conception 
of some positive way of acting. Record- 
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ings were used to illustrate what was 
meant, and there was also some role 
playing. 

The second topic we took up was the 
topic of the patient's view of his thera- 
peutic experience. There were a number 
of statements expressing the feeling that 
we do not know enough about just how 
patients do view their therapeutic experi- 
ence, and comments on the quite extreme 
differences there will be between the 
therapist's view of what has gone on in 
therapy and the patient's view. In the end, 
our discussion narrowed down to the pa- 
tient's view of himself, and treated various 
kinds of studies, some in which the pa- 
tient's view of himself is compared with 
either the therapist's view of him, the 
patient's view of how much was accom- 
plished, or the therapist's view of how 
much was accomplished. Dr. Hamburg 
reported a study by Board 1 where patients 
were followed up and where the thera- 
pists gave reports on how successful or 
unsuccessful they thought therapy had 
been. Dr. Hamburg was struck by quite 
a large number of instances where the 
therapist was quite definite in feeling that 
therapy was unsuccessful, but where the 
patient, at some period afterward, offered 
what he felt represented quite striking re- 
ports of something very meaningful hav- 
ing happened reports of changes in 
their interpersonal relationships, changes 
in their life situation that somehow were 
at variance with the terms in which the 
therapist had characterized the therapy. 

We also heard of a report of a study by 
Pfeffer, 2 in which the patients were given, 
what I would call, a very ambiguous task; 
they were simply asked to tell whatever 
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thoughts they had about therapy and to 
talk as much or as little as they wanted. 
One of the characteristic events that was 
noted here was the seeming resurgence of 
transference responses. 

There was a lot of emphasis upon the 
lack of correlation between, for example, 
the patient's view of himself before and 
after therapy and the therapist's view of 
him and independent observer's reports. 
There had been some remarks on this lack 
of correlation the day before. Dr. Butler 
reported on some studies 3 where, when 
the patient's report on himself was ana- 
lyzed further into purer more distinct 
factors, higher relationships were found 
with reports on the patient by the thera- 
pist and by others. 

Finally, we discussed the topic of ca- 
pacity to like the patient. It was proposed 
that the therapist's capacity to like the 
patient may possibly be one of the crucial 
variables in the therapist's ability to be 
helpful to him. Talking in terms of the 
therapist liking or disliking the patient, 
the question was raised whether there was 
a cultural or, perhaps, subcultural (thera- 
pist culture) pressure for the therapist 
to like or, at least, not to dislike his pa- 
tient, resulting in a reluctance of thera- 
pists to admit dislike. Some of us began 
to express more confidence in a therapist 
who could admit to liking and disliking 
than one who is reluctant. It may be more 
important for the therapist to be able to 
experience and to admit to these experi- 



1 Board, F. A. Patients' and physicians' judg- 
ments of outcome of psychotherapy in the out- 
patient clinic AMA Arch. gen. Psychiat., 1959, 
1, 185-196. 

2 Pfe#er, A. Z. A procedure for evaluating 
the results of psychoanalysis. /. Amer. Psycho- 
anal. Assoc., 1959, 7, 418-444. 



3 Butler, John M. Self -concept change in 
psychotherapy. Counseling Center Discussion 
Papers, I960, 6, No. 13. 

Rice, Laura N., WagstafT, Alice K., & Butler, 
J, M, Some relationships between therapists* 
style of participation and case outcome. Coun- 
seling Center Discussion Papers, 1961, 7, No. 
5. 

Wagstar?, Alice K., Rice, Laura N., & Butler, 
J. M. Factors of client verbal participation 
in therapy. Counseling Center Discussion 
Papers, I960, 6, No. 9. 
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ences of disliking as well as liking than 
it is for him to like the patient. In that 
connection there was general agreement 
that feelings of contempt for the patient 
were more likely to be detrimental to the 
therapeutic process than either liking or 
disliking as such. Along with that we 
moved into the discussion of the equal 
importance of the therapist's willingness 
to have the patient grow. I remember that 
Dr. Will was talking about experiences 
where it seemed as though the critical 
issue was the therapist's unwillingness to 
let the patient grow away from him and 
from his need for the therapist; in essence, 
perhaps the therapist needed the patient 
more, or as much, as the patient needed 
the therapist. We moved into a related 
idea that therapists do have needs, and 
that one of the basic gratifications of 
therapeutic work are those of partici- 
pating in the growth of other people, and 
that perhaps this gratification is intimate- 
ly related to the process of being grown 
oneself. This brings us back, of course, to 



the mutual effect of patient on therapist. 
And that concludes my part of the report. 
I think I would want to underline one 
of the last points that Dr. Haggard made 
by expressing my feeling that we could 
with considerable profit have gone a lot 
further, particularly at the level of getting 
down to specific methodological issues 
that would be involved in following up 
these kinds of ideas. I propose that a suc- 
ceeding conference be so arranged that 
one can move quickly into the develop- 
ment of these ideas within a small group 
so as to make possible the explication of 
just what are the methodological issues: 
under what terms would we be satisfied 
with efforts to observe the kinds of vari- 
able being discussed, and what kinds of 
experimental or naturalistic studies will 
test the fruitfulness of the ideas behind 
the variables? A conference, so organized, 
should be able to go far toward finding 
the answers to such questions or, at the 
very least, outlining in clear detail the 
obstacles to seeking these answers. 



Group Discussion 

DR. DAVID A. HAMBURG, presiding 
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DR. HAMBURG: Dr. Bordin, thank 
you. As a member of the group I was very 
much impressed that Dr. Bordin and Dr. 
Haggard have given an accurate and in- 
formative summary. It is a very difficult 
task. I would just like to underline a 
point, made by Dr. Haggard, that I feel 
about this group. There was a constructive 
balance involving respect for clinical ob- 
servation and hypotheses derived from 
clinical observation, along with a search 
for methods that would permit dealing 
with such hypotheses systematically and 
in some cases quantitatively. We did feel 
toward the end that we could very well 
pursue the discussion for another whole 
day. I think it is something to be consid- 
ered for future conferences whether 
something like one day of plenary sessions 
and two days for the small group discus- 
sions might be profitable. However, this 
was the experience of only one group. 

At this point we do have time for some 
discussion, so let us open it. Dr. Colby. 

DR. COLBY: If the group had con- 
tinued, I wish they could have come to 
grips with an interactional variable which 
seems to me to be very important, per- 
haps the most important, and that is the 
problem of the weight of meanings of 
statements. I realize the term meaning is 
very nebulous and the weight of meaning 
may be even more so. But it seems to me 
that linguists and information theorists 
and now research psychotherapists avoid 
the essence of utterances. They shirk the 
fact that it is not statements themselves; 
it is the meaning and import of statements 
that is crucial. It relates to the question 
of activity and nonactivity in therapy. If a 



therapist utters 200 sentences in a single 
session, we say he is being very active; 
whereas, if another utters one sentence, he 
is not being active. But those 200 sen- 
tences might have very little import to 
the patient. They carry no weight; they 
have no impact. The other therapist might 
be completely silent for 40 minutes and 
then utter one sentence of ten words that 
has a very strong reverberative effect on 
the patient; yet, I wouldn't want to call 
him an inactive therapist. It seems to me 
that he is a very active therapist. He can 
think of things to say which have a far- 
reaching impact on the patient. I realize 
it is perhaps useless to exhort, but I think 
we, the psychotherapists, have to face up 
to this hard problem of the meaning of 
utterances delivered by the therapist. 

DR. BORDIN: Would you be willing 
to call him a verbally inactive therapist? 

DR. COLBY: Yes. He is active in the 
sense of being able to produce activity in 
a system, whereas the other therapist who 
may be talking like mad produces no ac- 
tivity in the patient system. 

DR. BORDIN: I have the feeling that 
in our description of behavior we ought 
to try to get away from incorporating the 
impact in the description. If our theory 
requires that certain behavior has a par- 
ticular impact and we incorporated the 
impact in the definition, there could be 
no proper empirical test of the tenability 
of our theory. So I have some feeling of 
wanting to retain a description of the 
therapist's behavior that doesn't in itself 
incorporate a description of his impact, 

DR. COLBY: I would be willing to 
retain it, but put it secondary to effective- 
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ness which might be a better term than 
activity. 

DR. BORDIN: In effect, one could put 
what you have been saying as a theoretical 
proposition to be tested, namely, that the 
verbal activity of the therapist is uncor- 
r elated with the impact of his communi- 
cations on the patient. One could test that. 

DR. STEVENSON: Not without a 
good deal of evidence that the impact of 
the same words under different circum- 
stances can be extraordinarily different. It 
needs a great deal more study. The experi- 
ments on hypnosis bring this up very 
clearly. You say, "Fire!" The patient has 
been given a posthypnotic suggestion that 
when he hears the word "Fire!" he will 
feel as if the seat of his pants is hot. This 
has a totally different impact, that one 
word, than it would on somebody who 
was not so prepared. 

DR. HAGGARD: I would like to 
make an observation about something 
that has concerned me during these pro- 
ceedings namely, the reluctance to deal 
with the actual content of psychotherapy 
material. It is, of course, much easier to 
deal with the formal aspects than with the 
content. One reason is that we do not have 
any system for dealing with content, and 
in that we are like the linguists, persons 
studying aphasics, and so on. It is no 
problem to code and classify what words 
are used, but it is much harder to appraise 
how the words are put together, the im- 
plications of style or even "what is being 
said" by the patient and the therapist. 
And yet, in our project, we have found 
that when we did try to determine the 
meaning of the content, or even levels of 
meaning, we were able to learn much 
more of what was going on during the 
session than when we dealt with only the 
more formal aspects of the protocols. In 
other words, I want to emphasize that, in 
my opinion, we must not be misled into 
doing only what is easy, that we must also 
work out methods to study and analyze 



the content, and cannot ignore the fact 
that it is an essential part of psychotherapy 
material. 

DR. STEVENSON: Even content is at 
a level above what Dr. Colby is talking 
about. 

DR. SHLIEN: Let me second the 
opinions voiced by Dr. Haggard and by 
Dr. Colby. It seems to me that Dr. Hag- 
gard is saying that we should not concen- 
trate on what is measurable at the cost of 
what is significant. Education gives us an 
easier parallel to think about. We tend to 
measure the obvious and that means the 
most active displays. If activity were really 
all we cared about, we would just watch 
the teacher teaching madly. But what we 
really care about in education is learning, 
and we now measure that more impres- 
sively. But we don't do this in therapy. 
We focus too much on the parallel of 
teaching, not enough on learning. 

DR. HUNT: Mr. Chairman apropos 
of Dr. Shlien's seconding of the point 
made by both Dr. Colby and Dr. Haggard 
that our research should not concentrate 
on what is measurable at the cost of what 
is significant, and especially apropos of 
his drawing a parallel between psycho- 
therapy and education, I should like to 
recall Dr. Betz's semantics of "evoking 
change." I believe that psychotherapists, 
like educators, awe in the business of 
"evoking change." I like Dr. Betz's seman- 
tics better than I like the semantics of 
reinforcement which Dr. Krasner has 
brought to the focus of our attention at 
this conference. I prefer the semantics of 
"evoking change" because I believe they 
are descriptively more apt. I believe 
change occurs in organisms, and by 
change I mean both epigenesis and growth 
in the structure of behavior and in the 
structure of those central processes which 
mediate behavior. I believe growth in the 
structure of behavioral processes occurs 
when the situation or information en- 
countered is so related to the organism's 
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existing structure of behavior or of 
opinion, on the one hand, that it is rele- 
vant and, on the other hand, that it falls 
within the accommodative capacity of the 
organism. Although it is very much worth 
while to look at the psychotherapist as an 
educator, I suspect the investigations of 
those social psychologists who are study- 
ing attitude change are more relevant to 
the work of the psychotherapist. 

In this work, change in attitudes and 
beliefs is seen to be a function of the 
logical relationship between the message 
to which the subject listens and the atti- 
tudes and beliefs which the subject holds 
on the topic of that message. The ter- 
minology of Leon Festinger 1 is particularly 
apt. According to this terminology, change 
occurs when the relationship between the 
input message and the attitudes and be- 
liefs already in the storage is one of cogni- 
tive dissonance. This is to say that the 
message is related to those beliefs, but it 
disagrees with those attitudes and beliefs. 
But there is more than mere dissonance 
involved in evoking change. If the mes- 
sage is seen as too dissonant to be accom- 
modated by the subject, he will somehow 
discredit the message or the source of the 
message. I have begun to believe that 
many of the mechanisms of defense that 
Freud described are actually defenses 
against dissonance. Thus, the proper rela- 
tionship between the message and the 
existing attitude and belief structure in a 
person provoking change may be de- 
scribed as one in which the message ap- 
pears to the subject different enough from 
his akeady established attitudes and be- 
liefs to be interesting but not enough to 
arouse his defenses. Some of these studies 
of attitude change point out that the 
amount of change obtainable is markedly 
increased when the degree of dissonance 
in the message turns out to be greater 
than the subject was led to expect by the 
opening phrases of the message. 

1 Festinger, L. A theory of cognitive fos- 
sonemce. Evanston, 111.: Row, Peterson, 1957. 



Shakespeare was well acquainted with 
this principle. As you recall, he had Mark 
Anthony employ it in his funeral oration 
for Julius Caesar. In that oration, Mark 
Anthony opened with a statement, "I 
came not to praise Caesar but to bury 
him." He thereby started his oration with 
a statement that was very close to what 
his listeners already believed. As Mark 
Anthony proceeded to produce the mes- 
sage of his oration, he gradually intro- 
duced information which was more and 
more dissonant with those original atti- 
tudes and beliefs of his listeners. Inas- 
much as the dissonance was introduced 
gradually, however, those listeners were 
led along toward a very big change in 
their attitudes and beliefs. Mark Anthony's 
performance, of course, is merely a fig- 
ment of the Bard's imagination. It is not 
evidence. 

There are, however, a number of studies 
of attitude change (see especially Ewing 
and Festinger 2 ) which clearly demonstrate 
this principle that when the recipient of 
the message is led in the opening phrases 
to expect information which essentially 
agrees with his ready-made attitudes, the 
impact of the dissonant information that 
comes later makes an especially big 
change in the subject's attitude; whereas, 
if he is led by the opening phrases to ex- 
pect something that disagrees with his 
own ready-made attitudes, he will defen- 
sively discredit the message so that it has 
no effect on his attitudes and beliefs at all. 

I suspect that when nondirective or 
client-centered psychotherapy is used in 
the skillful hands of a Rogers, a Butler, or 
a Shlien, it becomes a mode par excellence 
of introducing messages to clients in 
which the dissonance is produced in small 
doses. On the other hand, in the interpre- 
tative therapies, I suspect that the disso- 

3 Ewing, T. N. A study of certain factors in- 
volved in changes of opinion. /. soc. Psychol., 
1942, 16, 63-88. 

See Footnote 1. 
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nance is often introduced in such larger 
doses that they provoke a good deal of 
defensive argument. I suspect we can 
profitably compare the work of various 
therapies from this point of view. 

Trying to do this will, however, create 
a technical problem, and this problem 
concerns the way in which we diagnose 
what the existing attitudes and beliefs of 
our clients are at any given time. I suspect 
that our existing modes of diagnosis such 
as the Rorschach and the TAT may not 
be very helpful here. We may well have 
to be satisfied with the import of what 
clients say within the therapeutic session. 
At any rate, I would like to see someone 
look at psychotherapy from the standpoint 
of the theory and methods employed by 
the social psychologists studying attitude 
and opinion change. I am inclined to be- 
lieve that insofar as the psychotherapist 
employs skill in managing the relationship 
between his messages and the attitudes 
and beliefs of his client or patient, he is, 
to use again Dr. Betz's phrase, "evoking 
change." 

DR. FRANK: It seems to me that the 
only way you can get at the meaning of 
communication is by the impact on the 
recipient. Dr. Hunt suggests that you have 
to know what the sets of the recipient are 
before you can judge what the meaning of 
the particular content of the behavior is. 
This is a nasty methodological problem. 

DR. BETZ: The word "attitude" has 
been used several times. This is a useful 
word for characterizing patients in our 
clinical vocabulary. 

Dr. Colby was focusing on what is 
significant as opposed to what is more or 
less volume. Methods are needed to meas- 
ure or show what is significant in clinical 
happenings the heightened moments 
and the valleys between. How to recog- 
nize them, how to conceptualize about 
them so that we can communicate mean- 
ingfully to other people this is an im- 



portant problem. One obstacle, method- 
ologically, may lie in the fact that we work 
with secondhand material a great deal, 
even when recordings or recorded tran- 
scripts are used. I would hope that we can 
begin to have more studies of doctors and 
patients in actual operational settings 
where what is happening can be observed 
while it is happening, as we are able to 
observe a surgeon when he is operating. 
There are problems here, but many of 
them are surely surmountable. 

DR. BLOCK: It seems to me that what 
we are talking about now is the hoary and 
thorny and usually evaded problem in 
psychology what is the stimulus. Dr. 
Colby suggested that we needed to be con- 
cerned with what is significant rather than 
what is simply easy to count or the fre- 
quency of words, and so forth, and I think 
or hope everybody would agree. I think 
the way he happened to phrase the prob- 
lem toward the end of his remarks pre- 
cipitated the countering reaction of Dr. 
Bordin. Dr. Colby said we shall know 
significance by the subsequent effect of 
the stimulus upon the individual. But this 
statement develops problems of logical 
circularity because the nature of science 
is such that one has to state in advance 
rather than retrospectively the effects of 
the stimulus upon the subsequent response 
or behavior change. Just how to set about 
to do this is a damnably difficult problem, 
but one must continually recognize that 
we cannot define significance in terms of 
subsequent effect. We cannot look back- 
wards in time and then decide what was 
significant if we wish to predict behavior. 

One admittedly unsatisfactory solution 
to this problem is to talk of what a stimu- 
lus or a therapist intervention should do 
to an individual I put should in quotes. 
Afterwards, one looks to see what the 
therapist intervention did do. By virtue 
of talking of what should, and what did 
happen, one can perhaps separate and 
clarify the notion of therapist intervention 



296 

and talk about it in advance and inde- 
pendently of the effect of this interven- 
tion. 

Going back to Dr. Haggard's remarks 
on the necessity of dealing with content, 
I would certainly agree. But I think there 
are formal qualities of content that if 
recognized would permit the classification 
and coding of the therapist's activity into 
incisive categories categories that re- 
spond to the meaning rather than the 
sheer volume of words. I do not think a 
systematic approach to therapy has to be 
reduced necessarily to the formalism of 
counting words and length of sentences 
and time gaps, 

DR. BUTLER: I want to clap my hands 
and say "Bravo!" to Dr. Colby on this, 
because I think that messages, which are 
embodied in the flow of the sequence of 
sentences, are very important and have a 
unity which neither words nor sentences 
have. And the next thing I would like to 
say is that in our group I think we con- 
sidered this in a certain sense which bears 
on your comment and might be worth 
bringing out to the conference as a whole. 
It is in this notion of activity level that we 
discussed as being different than thera- 
peutic intervention, as being in the 
dimension of active versus passive, active 
meaning being expressive. One hypothesis 
was that it increases meaningfulness for a 
given formal content and, therefore, in 
the respondent, whether he is client or 
therapist; the result would be increased 
connotations and possibly increased mean- 
ingfulness on the part of the respondent's 
own response, to be contrasted then with 
the less active type of statement or mes- 
sage which might be formally the same 
but does not have this stimulus value. I 
think one specific hypothesis that we dis- 
cussed along these lines was that for one 
kind of relationship, for example, in one 
kind of technique an increased activity 
level, in the sense of expressiveness on the 
part of the therapist, might lead to a great 
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increase in richness of messages from the 
client or patient. In another relationship 
the increase in connotation might be very 
anxiety-producing and produce both the 
impulses to express, and at the same time 
inhibiting effects of anxiety. What we 
came out with was something that can 
be studied, the relationship of activity 
levels to specific therapeutic strategies 
within a given hour in interaction. I think 
this really would be a quite desirable 
study, if done in a systematic way. 

DR. BOLGAR: With respect to Dr. 
Colby's suggestion, I think we have to 
differentiate between the emotional im- 
pact of the therapist's communication and 
its meaningfulness. It seems to me that 
this may have something to do with the 
therapist's activity level in terms of the 
quantity of communication. In the case of 
a classically silent therapist, the mere fact 
that he is making a comment may have a 
tremendous emotional impact on the pa- 
tient. However, I think that this is some- 
what different from making a meaningful 
comment which sets off a chain reaction 
that may manifest itself much later. There 
is also an important methodological differ- 
ence between finding evidence for the im- 
pact of a communication on the one hand 
and its long-range meaningfulness on the 
other. Usually the patient can and does 
indicate what made an emotional impact 
on him, but it is much more difficult to 
trace back a meaningful comment which 
may have started some very important in- 
ternal activity in the patient but may take 
a long and unpredictable period of time 
to re-emerge on the surface. 

DR. LENNARD: If you compare dif- 
ferent therapist-patient pairs, then the 
counting of the absolute volume of a 
therapist's activity is probably not very 
useful. But think of therapists who are 
operating within different orientations, 
who have different base lines for how 
often they talk, or how much they will 
say, then the volume of comments may be 
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related to impact. If a therapist is only 
going to talk if he has something very 
important to say, then if you compare 
hours for the therapist who is operating 
on a particular base line (sessions in 
which he talks more versus sessions in 
which he talks less) you can find some 
interesting things, as we did. For example, 
the patients were more satisfied with ses- 
sions in which the analytic therapist talked 
a little more. Now, you may point out the 
psychodynamics underlying this finding 
and say that the patient is interpreting the 
therapist's talk as a gift from the therapist. 
Yet interestingly, if you also ask the 
therapists, you will find that the therapists 
were more satisfied with hours where they 
talked somewhat more. All I am pointing 
out is that the variable of activity level in 
a formal sense, while certainly only a very 
small part of the total problem for analyz- 
ing the impact and the meaning of the 
therapists' statement, does nevertheless 
have some very useful implications for 
understanding differences in the vicissi- 
tudes of a particular therapist-patient pair. 

DR. BLOCK: In the final analysis we 
establish meaning only by the careful ex- 
plication in advance of what our goals for 
the patient may be. Clinicians are loath to 
do this, yet I cannot see any other way of 
handling this problem than to be able, in 
the beginning of therapy, to say in detail 
and on as many levels as possible precisely 
what the therapeutic goals are and how 
one hopes to achieve them. 

DR, COLBY: In response to Dr. Bloch, 
the clinical analyst has some rough and 
ready criteria by which he judges what 
should happen ahead of time. For ex- 
ample, when he offers an interpretation, 
let us say in the form of a causal correla- 
tion in which he asserts to the patient, 
"You do X because of Y," he expects, if 
the various empirical rules about timing, 
dosage, and tact have been followed, that 
the patient will then take up this correla- 
tion, elaborate it, extend it, qualify it, or 



reject it. At least he will process it as a 
piece of information in some way with a 
terminus that is roughly defined. If left 
alone, theoretically he should be able to go 
for minutes and maybe hours on it. 
Usually some external or internal con- 
tingency changes the associational flow. 
So one sort of response that we think 
ideally should occur after an adequate in- 
terpretation is that the patient should 
process it. When he doesn't, and often he 
doesn't when we have touched him at a 
sensitive spot, then we observe an avoid- 
ance of the message. He will not process 
it. He moves away from it or he falls com- 
pletely silent. Now this is a measure of 
immediate response to input which I 
think the clinician uses. He feels that he 
says something that has meaning, import, 
and usefulness to the patient if the patient 
is able to information -process it. 

DR. LEVINSON: I would like to com- 
ment on the title of the working group 
and their theme, the derivation of vari- 
ables. The discussion earlier focused main- 
ly on variables that people can think of. 
Presumably the research would start with 
variables that people have in mind and 
would try to see what significance they 
have, what else they are correlated with, 
what their consequences are, and so on. I 
think there is another kind of study that 
ought to be mentioned, the kind in which 
the aim of the study is the derivation of 
variables. One would spend time looking 
at what happens and then decide at the 
end of the study on a small number of 
variables that seem to be worth pursuing. 

This certainly is not a new idea. I 
imagine that we all agree that it is one 
useful kind of thing to do. It is often the 
aim in process studies to examine in a 
microscopic way what is going on in 
therapy with the aim of deriving variables 
for further study. Actually, we rarely do 
this. I think it would be worth including 
in our report what sorts of ideas there 
are in this group about this kind of re- 
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search. One reason we don't do it, I think, 
is that it is very hard to get it published. 
It just does not fit the model of the usual 
journal article. You are supposed to end 
up with conclusions about the way in 
which a variable operates rather than 
simply saying on the basis of a lot of 
qualitative observations, "I propose that 
this is an important variable; it is as far as 
I have gotten so far in my research, but it 
is still worth publishing on the basis of 
findings to date." 



several participants in this conference 
went through that strenuous process of 
following hunches about variables and 
gradually came to a formulation of prom- 
ising ones. Dr. Levinson did this. Dr. 
Butler, at the beginning of his paper, de- 
scribes the kinds of mental processes one 
must go through in listening to one's data 
to hear useful variables to measure. And 
the same is true of Drs. Siegal and Rosen's 
paper. Don't you agree? 
DR. LEVINSON. Yes. 



DR. LUBORSKY: I am impressed that DR. ROSEN: And Dr. Luborsky's. 
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It is hard to add meaningful comments 
to what you have already experienced and 
heard, but I have accepted the charge of 
the committee and will do my best. 

I shall present some reflections at levels 
a little different from what would be ap- 
propriate to the other reports and the 
general discussions. To begin with, since 
I was at the previous conference in 1958 
as well as this one, I should like to add my 
impressions to those of other participants 
in both conferences that there is a very 
striking difference between the two with 
regard to the much greater ease of all 
participants and openness to one another 
during the research conference. There was 
a much greater wariness m 1958, a feeling 
of being on guard, even to difficulty in 
hearing each other's rather different lan- 
guage, than I noticed at the present con- 
ference. This seems to me a great advance 
and perhaps gives us a suggestion as to 
the utility of devices of this kind in the 
future. 

I comment next on a number of issues 
which came up at this conference. With 
regard to the discussions we had about 
the variables significant for personality 
change, I was struck by the continued per- 
tinence of the eloquent statement by 
Gordon Allport ( 1955 ) , in his litde book 
Becoming, of his dissatisfaction with our 
not having found in psychology and psy- 



chiatry suitable units for personality de- 
scription, units of a kind which would 
represent adequately what we might call 
central rather than peripheral features of 
personality, features which deal with what 
gives us the feeling of a personality being 
well tied together rather than of a bundle 
of separate traits, responses, dispositions, 
or attitudes. This problem, it seems to me, 
is still just about as far from being solved 
in 1961 as in 1955. The search for suitable 
units of personality study is still in 
process. From this point of view, I thought 
that Dr. Shlien's attempt to deal directly 
with much more general ways of describ- 
ing personality, by use of variables at high 
levels of abstraction, was an exciting ap- 
proach to this kind of problem. There 
may be many other such novel attempts. 
This one may not prove to be useful. 
Whether you think of the variable of 
self-esteem he was experimenting with in 
a nonverbal way as one of high abstrac- 
tion, or high generality, or high centrality, 
or as belonging to what Allport called the 
proprium or the propriate system, the real 
I, makes no difference. I think none of us 
will be satisfied until we have units for 
personality study that are of this order or 
kind, the rest of psychology up to that 
time having to be considered as still being 
in an elementary state, even though a tre- 
mendous amount of effort has been neces- 
sary to take us to that state. 
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Content as a variable relevant to per- 
sonality appraisal was not discussed 
thoroughly at this particular meeting. 
Others have commented on it, and this 
has some significance. I want to mention 
also a point which Dr. Colby brought up, 
that we have paid relatively little atten- 
tion to the meaning of statements which 
are made. When we have a patient in 
action it is hard for us to study this matter. 
It is hard for us to design methods to 
estimate the impact of therapists' state- 
ments upon patients. In connection with 
this last point we have the interesting hint 
from Dr. Hunt that the students of atti- 
tude change can perhaps give us a notion 
of procedures which might be helpful. I 
believe that these procedures are used im- 
plicitly by skilful therapists, but that they 
have never been made the object of ade- 
quate study. Essentially, the procedures as 
Dr. Hunt described them seemed to me 
to amount to what, in psychotherapist 
language, is "knowing where the patient 
is," making very sure, by using his lan- 
guage and even his inflections and his 
tempo (as the more sensitive therapists 
that I have watched always know how to 
do), that you know exactly when you 
stand on common ground with such a 
patient. You then produce those dis- 
sonances which lead him to change his 
attitude along with you. Sometimes the 
first dissonance is simply a questioning 
inflection, joined to a statement which is 
an exact repetition in IQ 85 language of 
what the patient has said (if that is his 
IQ). 

One other comment about variables 
relevant for estimating personality change. 
The group which dealt with that topic 
pointed out to us again that single vari- 
ables are not likely to prove particularly 
predictive, even one we think of being so 
central as anxiety or subjective discomfort 
or relief of same. By and large this group 
came up with the notion that more than 
one informant was needed if you were to 
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form some reliable estimate of what had 
happened to a person as a result of psy- 
chotherapy, and that this kind of descrip- 
tion (of the extratherapist patient inter- 
actions) was most predictive of the out- 
come which in the long run is the pay-off 
of psychotherapy. There seemed more 
agreement than I have noted in previous 
years regarding the desirability of study of 
the outcome of psychotherapy as not being 
something limited to the therapist-patient 
interactions, but as requiring data from an 
ongoing natural or viable life situation. 

As study of outcome of psychotherapy 
was being discussed, another topic came 
up which was left completely unresolved 
because it sets before us two very broad 
pathways, either of which one could take, 
and both of which have been taken. These 
have to do with the criteria of success in 
psychotherapeutic efforts. Shall the cri- 
terion be reduction of illness? Shall the 
criterion have to do with growth of per- 
sonality? Although there is some obvious 
overlapping between these two concepts, 
psychotherapists will lean much more one 
way than the other, and will work in con- 
spicuously different ways with their pa- 
tients depending upon which way they 
lean. This topic was only mentioned and 
left. 

Dr. Levinson drew some important 
matters to our attention. As he tried to 
wrestle with the topic (therapist charac- 
teristics) in the group he was assigned to, 
he found it impossible to deal with that 
topic within the framework for discussion 
which our conference steering committee 
had arranged. Dr. Levinson rejected the 
scheme the committee had set up with its 
tripartite division of topics, and came up 
with a very interesting idea. He found he 
could not think separately of therapist 
variables and patient variables, variables 
useful for handling the therapist-patient 
interaction. He made an analogy between 
the career of a person who presents him- 
self as a possible client or patient ( from 



FINAL SUMMARY 



301 



the time of presentation until he is dis- 
charged from care) and other kinds of 
career: the career of a student, or the 
career of a professional person. In short, 
his analogy was with other kinds of social- 
ization processes. He regarded such a 
career as socialization process in terms of 
a number of domains, some seven of 
them; variables characteristic of the thera- 
pist could be important in any one of 
these seven domains right from the start, 
when a person appears before the thera- 
pist asking for therapy and being either 
accepted or rejected, until the termination 
of care when the person is discharged to 
the outer world. One can consider thera- 
pist variables in any one of the seven 
domains: acceptance rejection, therapist- 
patient interaction (properly called psy- 
chotherapy), the institutional setting, 
family setting, and so on. One can also 
consider the relation of therapist variables 
in one of these domains, for example, at 
the point of the applicant's appearance, to 
therapist variables in another domain, for 
instance, in the therapist-patient inter- 
action called psychotherapy. 

Levinson's portrayal of a patient's prog- 
ress, like Pilgrim's Progress, in terms of a 
career makes it more difficult to omit any 
of the essential elements which one has to 
consider if he wishes to evaluate either 
variables pertinent to personality change 
or significant about the therapist, or re- 
lated to the outcome of therapy. Levin- 
son's concept of a patient career also 
helped me to see more clearly where each 
of the very diverse approaches to the study 
of psychotherapy represented in this con- 
ference probably has its place. One could 
see that it was possible, by use of his 
scheme, to ask quite diverse questions 
about the patient's progress, in relation to 
his career at any point, and in terms of 
various levels such as Dr. Shakow was 
talking about Some of the studies repre- 
sented in the conference concentrate al- 
most exclusively upon the therapist- 



patient interaction as such, in greater or 
lesser detail. In material presented by Dr. 
Hedda Bolgar, emphasis was upon a very 
fine detail, a single act, the significance of 
which is examined during a single hour 
and also throughout a three-year process 
of therapist-patient interaction. Some such 
approaches, whether they concentrate on 
the therapist-patient interaction as such 
in fine detail or over a long period of 
time, nevertheless omit from regard what 
Levinson portrays as the beginning of 
those therapist-patient interactions: the 
antecedent domain of acceptance-rejec- 
tion, etc. Other investigators who concen- 
trate upon the therapist-patient interaction 
as such pay little or no attention to the 
subsequent domain: what follows the 
therapist-patient interaction. 

Levinson's scheme appears to be an in- 
strument of considerable utility. In addi- 
tion, its obvious face validity suggests the 
likelihood that if research on psycho- 
therapy continues to be too preoccupied 
with the therapist-patient interaction as 
such, we shall probably discover that such 
limiting of our concern to a part of the 
patient's career will turn out to have been 
limiting us unnecessarily in our theories 
of personality, society, and society-person- 
ality relationships. We will tend to start 
with a particular personality theory, to 
study the therapist-patient interaction 
within that framework and not be very 
hospitable to alternative personality 
theories which we would actually other- 
wise be more prone to consider were we 
looking at larger segments of the patient's 
career, including his impact on the outer 
world, his sodocultural situation, the 
effect of his class membership upon the 
initial portions of his career, and so on. I 
have the general impression that excessive 
concern with the therapist-patient inter- 
action as such as an object of research will 
tend to tie us to existing personality 
theory more rather than less, and to tie 
us to our pre-existing definitions of vari- 
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ables relevant to personality change more 
rather than less. 

In connection with Levinson's notion 
of a patient's career, one must consider 
the possibility that those characteristics of 
a dyadic interaction system which Len- 
nard has described for the therapist- 
patient interaction, as such, will turn out 
to have relevance for the interactions of 
the patient in the other systems of which 
he is a part during his career: the eco- 
nomic system to which he goes on con- 
clusion of the therapist-patient inter- 
action, or the institutional system if hos- 
pitalization has been a part of his career, 
his family, and so forth. In short, we are 
likely to want to find out whether the 
system characteristics Lennard thought 
relevant may be useful to us in other 
sustained interactions of the patient dur- 
ing his career. 

Some comments on Dr. Strupp's dis- 
satisfaction with the results of studies of 
the therapist-patient interaction as such 
are next in order. You remember he felt 
that our approach had been characterized 
by being oversegmental and prematurely 
experimental. He had the impression that 
investigators have been prematurely con- 
cerned with experimental design, rigor- 
ousness of design, statistical analysis, con- 
trols, and similar matters. He has been 
sufficiently dissatisfied with the results to 
date, as are many of us, that he thought 
one had to return to closer observation of 
the therapist-patient interaction or psycho- 
therapy process just as it occurs in the 
hope of discovering new leads for investi- 
gation. For such a procedure, he and others 
here used the term "naturalistic/* I say, in 
agreement with Dr. Krasner, that I don't 
see anything more "naturalistic" on the 
face of it about one kind of psychotherapy 
than another: Rogerian psychotherapy to 
me is as naturalistic or artificial as Freud- 
ian psychotherapy, or Adlerian, or other 
varieties. I think rather what one means is 
to study a particular therapeutic process 
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as it would be going on anyway if we were 
not subjecting it to deliberate experi- 
mental design or other manipulation. We 
want to look in on it and see if we can 
get any hints about aspects we could sub- 
sequently define more explicitly and per- 
haps make hypotheses about to verify in 
post hoc fashion, as Chapin (1955) did 
in his sociological studies, without having 
to limit or distort the situation or manipu- 
late it in advance. Studies can be con- 
ducted in the way Dr. Strupp proposes, 
but I think the term "naturalistic" need 
not be used in the way it was, as if it 
signifies some special virtue. 

Dr. Butler presented to the conference 
some observations of the client-centered 
therapy process as it occurs, in line so to 
speak with the kind of suggestion made by 
Dr. Strupp. As he examined afresh the kind 
of material long familiar to him, he made 
observations which, it seems to me, must 
modify the generally held conception of 
the therapist's behavior in client-centered 
therapy. (Such leads, I take it, are Dr. 
Strupp's objective.) You remember Dr. 
Butler found that successfully treated 
clients more often had worked with a 
client-centered therapist who was more 
expressive and more active in a complex 
way defined in his paper. These therapists 
had been doing more than reflecting and 
clarifying what a client said. Dr. Butler 
was saying that as I look at this process, 
which I have been familiar with for quite 
a number of years, with a fresh eye, I find 
that the more the therapist is active in 
certain ways, the more his behavior shows 
aspects outside his conceptual framework, 
the more responsive patients are in a way 
which the same therapist calls successful 
treatment. He used such words as "ex- 
pressiveness" and "activity" to character- 
ize this rather noticeable departure from 
the orthodox conception of client-centered 
behavior. 

Dr. Butler's observations at once raise 
such questions as, why couldn't one train 
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therapists to put on expressive and active 
behavior experimentally? If experimental 
observation shows that such behavior is 
systematically predictive of more success- 
fully treated cases, why can't it become 
part of a therapist's armamentarium of 
therapeutic skills which his teachers help 
him learn? 

But increased therapist expressiveness 
and activity are not always useful. You 
remember Dr. Haggard's report, in con- 
nection with his group's discussion about 
ambiguity, that under conditions of low 
expressiveness, low activity, low specificity 
and high ambiguity of therapist's be- 
havior, certain patients definitely talk 
more, show more variation in their talk, 
and shift more from topic to topic. In 
other words, there are patients for whom 
contrary to the observations Dr. Butler 
made in client-centered therapy the 
more the therapist is in the background 
and not explicitly definable, the more the 
patients come out of themselves. I put 
these two observations together and say it 
is impossible to maintain that therapeutic 
effectiveness can be reduced to any one 
formula for therapist behavior. Will one 
have to become sensitively aware, possibly 
by emitting one's own behavior as signals, 
that the patient belongs to the class with 
whom the therapist had better be "low 
specific and high ambiguous," or to the 
dass with whom the therapist had better 
be "high expressive and Butler active"? 
Clearly this means highly individualized 
therapist procedure, but again I point out 
that this is quite sensible to therapists not 
committed to any existing allegedly cor- 
rect framework. Furthermore, such indi- 
vidualizing of therapy can be studied ex- 
perimentally, it can be taught system- 
atically, and it can be learned. 

It is natural to relate the material of 
Drs. Butler and Haggard to Dr. Krasner's 
review of operant conditioning proce- 
dures. The discussion of these procedures 
aroused more feeling than any other topic 



during the conference. These procedures 
will probably continue to arouse strong 
feelings for a variety of reasons. Dr. 
Krasner will probably continue to be de- 
liberately provocative (if we could get 
him to admit it) as he was by describing 
the therapist in the title of his paper as a 
social reinforcement machine. All he has 
to do is to use the word "machine" in that 
context and his hearers will respond 
strongly. One could start out with a stand- 
ard question: if the therapist is a rein- 
forcement machine, is a reinforcement 
machine a therapist? If one starts off with 
that, one generates at once a wonderfully 
hot discussion on fundamental viewpoints 
about the nature of men and of machines. 
To return to Dr. Krasner's presentation 
what is being done now with operant con- 
ditioning is evidently covering an increas- 
ingly broad spectrum of behaviors in 
animals and man. The behavior being 
studied by this method is becoming in- 
creasingly complex. The possibility that, 
to an unknown extent, man's operant con- 
ditioning behavior may be a response to 
personal or social expectation a placebo 
effect does not reduce the importance of 
the procedure. The work of H. K. Beecher 
(1955) on "the powerful placebo" leads 
to the conclusion that we shall have to 
take such placebo effects into account far 
more explicitly than heretofore, whether 
we be dealing with them in pharmaco- 
therapy, in surgical therapy, or in psycho- 
therapy (including subdivision operant 
conditioning). There is much about 
operant conditioning along these lines 
which we have yet to understand. We 
should not be unaware of the ingenuity 
which can be applied to some of the pro- 
cedures; probably we are about to see new 
developments of them rather rapidly. 

The limits of behavior change by 
operant conditioning techniques are of 
course not known. To what extent be- 
havior which is altered by operant con- 
ditioning (and for whatever reason in- 
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eluding the placebo type of reason) is 
followed by appropriately integrated 
physiological states, such as symptom loss 
or altered feelings, altered thinking, or 
altered attitudes remains to be learned. 
One cannot exclude the fact that such 
accompanying alterations may occur, since 
over and over again it can be observed 
that if a person can carry out a new, more 
effective response, a new, more effective 
visible behavior in a formerly self-defeat- 
ing situation and does it with reward, does 
it X times (whatever X is for him), he 
then develops new thoughts about him- 
self, thoughts which are integrated with 
his new behavior, and new attitudes, new 
feelings, and different physiological states. 
If he has the idea I am now a more self- 
confident person and has begun to act 
more self -confidently, he soon has also a 
different feeling about himself, and his 
physiological state is different. In other 
words, it is not at all an unimportant 
question to wonder whether one can alter 
behavior by operant conditioning meth- 
ods, even if the alteration is brief. One 
must not minimize in advance the possi- 
bilities here by saying, "Well, it's only 
overt behavior that is changing," or "It's 
only verbal behavior," because in the long 
run, if you watch people and if you watch 
children, it is behavior that is learned first. 
They then develop thought systems which 
explain to themselves what their behavior 
is like. It is very difficult to say to a per- 
son, "Stop having thoughts A and B," 
"stop having feelings C and D," "stop 
having hyperactive stomach or hyperac- 
tive bowel." It is easier to say, 'Talk, do." 
What one can observe happening, if one 
can make the right guesses as to what new 
behavior could occur and be reinforced, 
is that in association with successful new 
behavior one sees a new integrate of new 
successful behavior, attitude, feeling, and 
physiological function. This is the possi- 
bility suggested by operant conditioning, 
even if it is effective, by itself, only briefly. 
There may result new appropriately inte- 
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grated states at all levels. How such new 
states generalize to other interpersonal 
situations remains to be learned, as well 
as how long they will endure. 

Dr. Krasner has already begun to ex- 
periment with procedures which deal with 
these questions. He has been able to de- 
sign operant conditioning settings in 
which schizophrenic patients take more 
responsibility, pay more attention, receive 
more attention, take initiative in short 
become involved at multiple levels of in- 
terpersonal activity. For the nonpartici- 
pating schizophrenic patient, such in- 
volvement is potentially of major signifi- 
cance. If one can achieve it by operant 
conditioning methods and it is sufficiently 
rewarding to endure for even a short time, 
and to generalize to new situations, the 
possibility arises of unfreezing certain 
self-defeating patterns in patients by 
methods like this which may have nothing 
to do with the conventionally defined 
psychotherapy process as such. It may next 
be possible to find intermediate steps from 
such an unfreezing by a briefly enduring, 
feebly generalizing operant conditioning 
procedure to having the patient learn to 
so use his own symbolic processes as to 
set up self-perpetuating rewarding ways 
of behavior of high generality and long 
persistence. The next step beyond that 
will be to help the patient find for himself 
in the world outside the therapist-patient 
interaction those self-perpetuating inter- 
personal situations which he has come to 
know how to define so as to include the 
reinforcers which he needs for his new 
behavior. One cannot say how much of a 
place operant conditioning will find in 
such a sequence of therapeutic events, or 
of a patient's career. 

Dr. Krasner mentioned some interest- 
ing experiments which indicated that 
operant conditioning need not have first 
place in such a sequence: after sensory 
deprivation, under certain circumstances, 
operant conditioning is quicker. Imagine 
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the fascinating possibilities of starting 
with sensory deprivation to produce an 
organism sensitized to operant condition- 
ing procedures, having already found out 
a little bit about the patient's self-defeat- 
ing patterns in a few interviews, and then 
trying particular operant conditioning 
procedures. If the specifically chosen 
operant conditioning procedures are effec- 
tive, perhaps the patient can break out of 
his mold quickly. But how can one make 
such effects endure? How can one make 
them generalize? How can one extend 
them into his thinking, his self-regulating 
mechanisms and (outside the therapist- 
patient interaction) into the necessary 
interpersonal self -perpetuating regulating 
mechanisms? The possibilities I have 
mentioned are based upon a resolute re- 
jection of the premise that we can expect 
the therapist-patient interaction by itself 
to produce a permanent result independ- 
ent of external physical and interpersonal 
conditions. They are based also upon an 
acceptance of the notion that the integrity 
and stability of a person's functioning de- 
pends upon the continued integrity of the 
web of external circumstance in which he 
is immersed (as all the work on sensory 
deprivation demonstrates). 

From the point of view I have been 
presenting, whether one is making "na- 
turalistic" observations of the psycho- 
therapy process or is doing experimenta- 
tion becomes an unimportant question. 
When I say unimportant, I do not mean 
that naturalistic observation isn't useful, 
but I don't see that the distinction means 
anything. I cannot tell you which kind of 
knowledge we will find more useful and 
at which points, but I see no point in 
looking at these two approaches to the 
study of alteration of personality or of 
behavior as if they must be mutually ex- 
clusive. 

If operant conditioning techniques in- 
crease in diversity and complexity, if they 
stand up as useful, we shall have to give 



careful attention to the implications for 
the control of patients' behavior which 
such methods involve. If these methods 
continue to show promise, no matter for 
what reason, psychotherapists at that point 
will not be able to escape dealing with 
the same ethical dilemmas that our col- 
leagues in all other agencies which have 
social control as part of their function 
have to face, whether these be political 
agencies, educational agencies, or military 
agencies. We shall no longer be able to 
take the position that in psychotherapy 
permissiveness is all, that love is all, that 
we never control, that we have only the 
noblest interests of the patient at heart, 
etc. You will find that just such language 
is used by the agents of Chinese thought 
reform a far from permissive procedure 
as quoted by Lifton ( 1961 ) in his book 
on Chinese totalism. Even more the per- 
sons who have gone through the (total- 
istic) processes of having their behavior 
so thoroughly controlled come out with 
the same statements about themselves as 
our graduates of psychotherapy "I had a 
most extraordinary beneficial experience; 
I express myself more freely; I am closer 
to others; I am a nobler human being." 
At certain levels there seems little to dis- 
tinguish the statements of the graduates 
of thought reform, who are thoroughly 
controlled in the way Americans say they 
despise, from the statements of the pa- 
tient-graduates of psychotherapy in our 
society. The differences many of us believe 
to exist between these two procedures 
will become even less clear if the impli- 
cations I have been sketching, of our pres- 
ent operant conditioning procedures, be- 
come explicitly defined and used practices. 
Perhaps the dilemmas instigated by our 
awareness that there may be more con- 
trol of a patient in psychotherapy than 
we like to think and the kinds of safe- 
guards we could think about in our society 
are worth another conference. I should 
like to draw to your attention that as far 
as I know only B. F. Skinner (1953) faced 
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this issue clearly and openly, years ago. He 
labeled psychotherapy one of the agencies 
of social control and tried to examine it 
as such. Those of you who read his extra- 
ordinary book, Walden Two (Skinner, 
1955), have experienced appropriate 
shudders, and those of you who have not 
read it will find it germane to this con- 
ference. 

A number of things which came up 
during the three days are worth stating 
for the record of the conference. Each of 
the three working groups indicated that 
they felt a lack of closure about the time 
that they had spent together. They all got 
to points beyond which they wished to 
continue. That is a fine way for a con- 
ference to go. These are, as Dr. Hunt re- 
minded us two days ago, typical Zeigarnik 
effects. I have the idea that it may be be- 
cause of such lack of closure in the 1958 
conference that we started off this time in 
such a very different way and continued 
our functioning in a far more open way 
with a minimum of defensiveness. A 
number of suggestions were made with 
regard to this general state of lack of 
closure. There is, of course, an obvious 
one another conference like this. But 
when? Robert Harris, who wrote the re- 
view on psychotherapy in the Annual Re- 
view of Psychology several years ago, 
commented on how little difference there 
was in the literature he surveyed in that 
year from what I had surveyed a few years 
before. He thought the tempo of develop- 
ment of the topic was such as to warrant 
a review every five years. This is three 
years after the preceding conference. Our 
committee might be thinking about a 
suitable time interval if another confer- 
ence is thought to be useful. A summer 
conference was suggested by Dr. Bordin 
for a smaller group working more closely 
on a more limited number of topics for 
perhaps a longer number of days. A sug- 
gestion was made by Dr. Butler for co- 
operative research ventures involving 



some of the conference participants. This 
was also made at the last conference, as I 
remember; this is like the cooperative 
clinical studies in any field concerned with 
chronic intermittent disease problems. Ex- 
amples are the world-wide cooperative 
clinical study of rheumatic fever, cortisone 
and aspirin; and the Veterans Administra- 
tion hospital studies on psychotic reac- 
tions and tranquilizers. The suggestion 
was made that ideas for the evaluation of 
therapy could be gathered and pooled; 
perhaps that a variety of evaluation tech- 
niques in use could be examined by a 
group and important redundancies could 
be found. These redundancies could be 
pruned, and a scale which survived could 
be used by more investigators. This has 
its own hazard of the least common de- 
nominator phenomenon. You remember 
that Dr. Butler objected that perhaps at 
the present time it is wise to allow what 
look like redundant instruments, variables, 
and approaches to exist but to keep on 
talking to each other about where the 
perturbations are. That is how the new 
planets were discovered, he keeps telling 
us, and I think we have to remember 
there are very important virtues in such 
an approach. 

I had the impression that dissatisfaction 
was general, even with such a central con- 
cept as "anxiety," although many people 
felt it had some usefulness. We have diffi- 
culty in defining it or its parameters, de- 
spite the excellent things written about it 
by people like Professor John Reid (1956) 
and various students of drive in psy- 
chology who have tried to anchor it opera- 
tionally to antecedent and consequent cir- 
cumstances. The question was raised 
whether, as a construct, it is definable, 
useful, or even necessary. 

A question of great interest was raised 
by Dr. Bloch about the necessity of our 
looking upon our own function (as stu- 
dents of psychotherapy) in a social con- 
text. Dr. Levinson had drawn to our at- 
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tention that problems of patients could be 
looked at in terms of the career of the 
patient by analogy with other careers. 
Medicine everywhere has a social function 
and reflects its society. We, too, must be 
part of a social context, Bloch was saying. 
What is the context of psychotherapy in 
our society? We have a society which has 
more psychotherapy than any other so- 
ciety. We differ in various other ways 
from apparently similar societies. Are 
there meaningful relations between such 
statements? 

On this note I shall conclude, Mr. 
Chairman, and say that I have left many 
questions for the rest of the conference 
to answer. 
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Research Problems in Psychotherapy: 
A Three-Year Follow-Up 

LESTER LUBORSKY, PH.D. AND HANS H. STRUPP, PH.D. 



No matter how the field of psycho- 
therapy research is segmented for the sake 
of a conference, it makes little difference 
in a free discussion; whatever the desig- 
nated topic, people soon discuss the same 
basic issues. This was true of the first as 
well as the second conference. Therefore, 
the organization of headings in the final 
chapter of the last conference book 
Research Goals, Research Methods, and 
Selection of Variables works as well for 
our chapter and, in addition, facilitates 
comparisons between the two conferences. 
These headings are not arbitrary; they are 
the actual topics around which the discus- 
sion clustered. 

The Parloff-Rubinstein chapter is an 
incisive summary of that conference and 
of the issues of psychotherapy research in 
1958. We will use it as a point of refer- 
ence to follow up on what has remained 
the same or changed in the three-year in- 
terval. In this chapter we shall highlight 
the issues that emerged in the course of 
the present conference and consider how 
well its aims were reached. By pointing 
out the growing edge of work in this area, 
we hope to offer useful leads to investi- 
gators. 1 

1 For our source material for this chapter we 
will draw on : 

(a ) The papers submitted to the conference 
(&) The prepared discussions of each topic by 
Drs. Kenneth Mark Colby, Nevitt Sanford, 
and David Shakow 

(c) The summary reports of the panel discus- 
sions by Drs. Morris Parloff, William U. 
Snyder, Jack Block, Ian Stevenson, Edward 
S. Bordin, and Ernest A. Haggard 
(d} The final summary by Dr. George Saslow 
(e) The recorded comments of each partici- 
pant (for Days 1 and 3) 



The planners of the second conference 
tried to give it greater focus than the first 
conference. While the first was designed 
to give a broad overview of current re- 
search efforts in the field, the present 
meeting centered upon (a) factors asso- 
ciated with change in psychotherapy; ( b ) 
the role of the therapist; and (c) prob- 
lems in the selection of relevant variables. 
Additional objectives included: considera- 
tions of recent research contributions and 
significant new developments; review and 
follow-up of several projects which were 
in the formative stages at the time of the 
first meeting; and exchange of informa- 
tion among investigators. The planners 
hoped to provide continuity of contact 
among investigators which might guide 
and stimulate further research. Finally, the 
hope was to place research in psycho- 
therapy more squarely within psycho- 
logical research concerned with the under- 
standing of interpersonal processes. 

RESEARCH GOALS 

Everyone contributing to the conference 
seemed to be going his own way, but not 
so blithely as was the case three years ago. 

(/) The postconference questionnaire of each 
participant containing reflections upon the 
conference. 

The editors drew heavily upon the above ten 
discussants for the content of this final chapter. 
We owe them a special debt. 

Several helpful readers contributed opinions 
and suggestions: Drs. Aaron T. Beck, Albert 
Stunkard, Albert E. Scheflen, Eli Rubinstein, 
Lloyd Silverman, John M. Butler, Cyril Sofer, 
and Morris Parloff. We also wish to acknowl- 
edge the intensive critical reading by Dr. Martin 
"Wallach and the editorial consultation of Mrs. 
Ruth Samson Luborsky. 
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Some of the diversity in the conference 
was limited by the Planning Committee's 
invitation of papers in only three areas. 
These were, however, broad areas, and the 
papers were intended to be a representa- 
tive sample of current projects. 

Since our subject, psychotherapy, is so 
complex, one response at the conference 
was that we should congratulate ourselves 
on our diversity. At this stage of psycho- 
therapy research, it was thought, we need 
to make many diverse beginnings to try 
out methods and concepts. Then we 
should distill the better approaches, 
throwing out the poorer ones. 

The goal of most of the research con- 
tributions was to identify one or two 
interactions among or within the main 
sets of variables: patient, therapist, treat- 
ment, or life situation. The accent now- 
adays falls upon interactions among these 
variables, for example, "the relationship 
of treatment frequency to patient change," 
or "the interaction of therapist personality 
and patient change," etc. Another large 
group of papers aim at methodological 
clarification and better definition of vari- 
ables; these have high priority at the 
present stage of psychotherapy research. 

Outcome vs. Process Studies 

These alternatives as incentives for de- 
bate have been outmoded and put away 
in the closet. A review requires taking 
them out, brushing them off, and trying 
them on to see what was in vogue. Studies 
of outcome were those that asked the 
question: what changes took place in 
treatment These studies typically used 
patient or observer ratings of improve- 
ment or psychological tests before and 
after treatment. The process studies asked 
the question bow change came about and 
typically used microscopic analysis of the 
records of the treatment. 

In the last psychotherapy conference 
the editors devoted a considerable section 
of their final chapter to the reasons why 



outcome studies have been scorned by 
psychologists. Most of the critical attitude 
toward outcome studies originally came 
from their association with applied re- 
search and their reliance upon unsophisti- 
cated improvement ratings. Apparently 
the last conference worked through this 
prejudice against outcome studies, and the 
improvement has been maintained at the 
present conference. Very little heat could 
be generated by this issue; the conferees 
seemed done with it as an issue, although 
it was referred to by some people in the 
postconference questionnaire. The tenor 
of the comments reveals acceptance of 
outcome studies because of the greater 
sophistication of recent work. The feeling 
was that there are many passable roads 
and that both the outcome and the process 
roads are respectable. 

Process Scoring Systems 

For many years researchers in this area 
have hoped that generally applicable scor- 
ing systems for the process of psycho- 
therapy could be developed. Although this 
hope has not been fully realized, technical 
improvements have constantly been in- 
corporated in the newer process scoring 
systems. Many of these have come from 
the field of communications analysis, 
which has made great strides in the past 
two decades. Several annual reviews of 
psychotherapy research have referred to 
process scoring systems as getting better 
from year to year as more new systems are 
developed. In the last psychotherapy con- 
ference two new systems were described 
(the Rogers' content analysis system for 
the dimensions of experiencing and the 
promising but overcomplex psychoanalytic 
process scoring system by Leary and Gill) , 
At the present conference at least three 
process systems were represented (Butler, 
Lennard, and Strupp). 

Despite this profusion of instruments, 
most researchers have felt the need for 
manufacturing their own brand. As a re- 
sult, there is no generally accepted or 
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thoroughly investigated system. Further- 
more, one cannot detect sustained interest, 
either by the originator or others, in any 
one system systems like the Discomfort- 
Relief Quotient or Raimy's PNAvQ 
which were popular a decade ago are 
rarely used now. The reasons for this state 
of affairs are complex. In addition to 
technical difficulties of quantification, 
systems are usually anchored to particular 
theoretical orientations; consequently they 
are limited in scope and not very useful 
for comparisons across theoretical boun- 
daries; and finally, for the testing of spe- 
cific hypotheses, specific systems are 
needed. The Bales system of interaction- 
process analysis, designed as a general- 
purpose system, seems to have greater via- 
bility than most, although it may be too 
general for many research purposes in 
psychotherapy. 

One of the scoring systems taken up by 
the conference (Butler) was discussed in 
terms of its psychological sophistication 
which entails a high demand for fine judg- 
ments. This is a persistent requirement of 
many systems and one that creates re- 
sistance to its application by other re- 
searchers. However, the trained human 
instrument when JcepTlfirBSunds tycon- 
trols o^^elS^Sy^is 'weTr^equipped to 
make many complex discriminations. In 
the conference there was^bnsTderaEIe em- 
phasis on the need to define larger psycho- 
logically meaningful units or themes that 
are related to psychotherapy process and 
outcome (possibly, e.g. shifts in major 
transference pattern). However, the re- 
sistance to scoring complexity is not 
deeply seated; it probably arose in this 
conference from two precipitating events: 
the overcomplexity of several recent sys- 
tems and the contemplation of the analysis 
of miles of tape and film of psychotherapy. 

Personality Theory 

Most psychotherapy researchers hope to 
contribute ultimately to basic personality 
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theory. They share the common faith that 
a good theory of personality will emerge 
from a good theory of treatment ( and vice 
versa). 

In the conference the specific bodies of 
theories which were most often discussed 
were: (a) learning theory, (&) theory of 
social processes, and (c) psychoanalytic 
theory. The part of learning theory most 
frequently referred to was the theory of 
verbal or operant conditioning. A number 
of participants were also fascinated by the 
application of the concept of "deutero- 
learning" to psychotherapy. Their feeling 
was that much of the learning that takes 
place in psychotherapy is in the nature of 
learning how to learn. One not only learns 
to work out specific conflicts, but learns 
the general principles of working out con- 
flicts for oneself. 

An amorphous issue, the extent to 
which psychotherapy is a socialization 
process, came up for discussion. It cer- 
tainly seemed questionable to most par- 
ticipants to speak of psychotherapy as 
though it were only another version of a 
parent-child relationship, even to the 
many participants who thought primarily 
in terms of psychoanalytic theory. 

Despite the fact that psychoanalytic 
theory in both its clinical and metapsycho- 
logical aspects is increasingly being re- 
garded as the most comprehensive attempt 
to account for psychic processes, it cannot 
be said that the theory has led commen- 
surately to controlled psychotherapy re- 
search investigations. The methodological 
obstacles in the theory have been dealt 
with exhaustively by Rapaport (I960). 
By this time one would expect to have 
seen research focused on such central con- 
cepts as transference, resistance, the ego's 
defensive and adaptive operations, inter- 
pretations (to name but a few). Nor was 
a great deal of discussion devoted to these 
topics at the conference. 
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METHOD 

Problems of method, especially in the 
choice of variables, were a leitmotiv 
throughout the conference. In fact, method 
tended to be more enthusiastically dis- 
cussed than research findings. There were 
several possible reasons for this: (1) Re- 
searchers in this field have been deeply 
concerned with problems of method, for 
they are convinced that one of the greatest 
impediments to progress is the lack of 
powerful yet practical methods. (2) When 
there is diversity of interest in a group of 
discussants it is sometimes more com- 
fortable to stick to topics which everyone 
has thought about and everyone has in 
common. 

As was true at the last conference, the 
most natural division of participants, ac- 
cording to preference for method, was be- 
tween experimenters and naturalists. The 
distinction may not have been quite so 
clear as it was at the first psychotherapy 
conference, but it was still there. There 
were probably more participants at the 
second conference representing the ad- 
vanced view that both approaches can be 
useful and might be tried even by the 
same person. This issue was not so sharp- 
ly drawn as it was in the last conference, 
but possibly because this was a more 
placid meeting. Even pronouncements like 
the following seemed to produce more of a 
peaceful consensus than they posed a threat 
to the experimentalists: The crisis in our 
field comes from the fact that the honored 
methods of physical science and mathe- 
matics have not helped the psychological 
sciences as much as they have the physical 
sciences; we may have to be more in- 
genious in using these methods, or make 
new ones of our own. 

Naturalistic Observation vs. 
Experimentation 

The contributions at this conference 
showed growing recognition of the special 



suitability of naturalistic observation for 
pllycfaothefapy research^ Next to the topic 
oF operant conditioning, this one pro- 
voked the most sustained discussion. 

A curious satiation effect developed 
around the constant use of the term 
"naturalistic observation." It seemed to be 
the same kind of satiation effect that one 
gets from repeating any term over and 
over a gradual disintegration of mean- 
ing. People began apologizing for the 
term "naturalistic" One participant fin- 
ished off the term "naturalistic" by saying, 
"Well, 'observation* expresses it well 
enough. The word 'naturalistic* before 
'observation' is superfluous. I don't know 
what an unnaturalistic observation 1 would 
be." It was as though the term "natural- 
istic observation" had run its life course 
in the three-day period of the conference 
among some of the participants. The na- 
turalists, however, seemed to remain cer- 
tain of the value and the vitality and 
capacity of the idea to rise from the dust. 

The editors of the first conference re- 
port gave a lengthy account of the sets of 
attitudes going along with a belief in 
naturalistic observation vs. a belief in ex- 
perimentation. We shall not attempt to 
reiterate their points, but only to high- 
light that part of the controversy which 
was most prominently reproduced at the 
present conference. There seemed to be 
three core themes in the discussion: (a) 
the capacity of each approach to get at the 
complexity of the phenomena; (b) the 
capacity of each approach to be genera- 
tive of new hypotheses; and (c) the rela- 
tive status of the two approaches in terms 
of scientific prestige. 

To some participants, the naturalistic 
observation approach seemed ideal for 
getting at the complexity of a phenome- 
non. On the other side, experimentalists 
were willing to run the risk of missing 
some things in order to gain the chance 
of isolating and manipulating one aspect 
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of a phenomenon. In terms of genera- 
tivity, some participants asserted that 
when experiments go wrong they do not 
lead to discovery, whereas observations 
can always lead to new experiments. The 
reply of the experimentalists was that one 
can miss things too in the observational 
method, because of the complexity of the 
phenomena. 

Some conferees expressed annoyance at 
the naive assumption that verification of 
hypotheses through experiment can be the 
only way of testing knowledge, and at the 
uninformed contemporary overevaluation 
of statistics and complex research design. 
Hypotheses can obviously be examined 
from the recorded data of psychotherapy; 
therefore, the testing of hypotheses is not 
a function solely of formal experiment. 

Experimental Analogues of Psychotherapy 

This section takes up the relative merits 
of "the real thing" (psychotherapy itself) 
vs. quasi-therapeutic or therapeutic analo- 
gies as media for psychotherapy research. 
A simpler way to put the topic is: "Which 
questions can be answered in the labora- 
tory and which cannot?" Two main ex- 
amples of experimental situations were 
discussed in this conference: (a) filmed 
sequences of psychotherapy to which 
therapists respond (Strupp); (b) verbal 
and operant conditioning or reinforce- 
ment experiments (Krasner). The discus- 
sion centered predominantly about the 
operant conditioning experiments and 
relatively less on the film techniques. The 
latter seemed to most people the more 
acceptable and justifiable experimental 
analogue, since actual therapy (or acted 
therapy) was the stimulus to which the 
judges responded. 

Even though the participants had seri- 
ous objections to the operant condition- 
ing experiments and the experimenters' 
theories, some of them were intrigued 
almost against their better judgment by 
the ingeniousness and possibilities of the 



approach. The discussion on this topic was 
quite lively, with people feeling strongly 
pro and con mostly con but the net 
effect of the discussion was a heightened 
interest in the area. Many participants, 
however, remained bothered by (a) ethical 
questions raised by the operant condition- 
ing techniques, and (b) serious differ- 
ences between the conditioning situation 
and the psychotherapy situation that made 
any inferences tenuous or even impossible. 

The tenor of the comments concerning 
the ethical implications was that these 
conditioning experiments promoted the 
wrong idea about the degree to which 
people are predictable and controllable. 
They imply that the therapist is a ma- 
chine. Many participants, especially those 
who were primarily clinicians and thera- 
pists, objected to the words "control" or 
"influence," and preferred instead to think 
of the patient's own wish to change. The 
therapist wants to evoke change, not force 
change. 

Seven types of differences were sug- 
gested between operant conditioning ex- 
periments and psychotherapy. These led 
many participants to decide that one can- 
not directly apply results from condition- 
ing techniques to psychotherapy: 

1. The role expectancies in operant 
conditioning and in psychotherapy are 
quite different. Patients in psychotherapy 
are ordinarily voluntary participants who 
want to change in certain areas. Subjects 
in an operant conditioning experiment do 
not experience themselves as being in a 
helping relationship; they participate for 
a variety of (often unrelated and unclari- 
fied) reasons. 

2, The change that can be effected 
through operant conditioning may not be 
very deep, lasting, or extensive. 

3* The extent of the emotional involve- 
ment in operant conditioning experiments 
is considerably less than in psychotherapy. 

4. Change in psychotherapy is mediated 
quite differently. 
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5. Individuals who do change via oper- 
ant conditioning experiments are those 
who want to please. This is not necessarily 
true in psychotherapy. 

6. The definition of reinforcement is 
too general in the operant conditioning 
experiments. It is unclear what is being 
reinforced. 

7. The nature of that which is influ- 
enced in psychotherapy is much more 
complex than that which is influenced in 
operant conditioning; for example, in 
operant conditioning it is "plural nouns" 
or some such specific response. 

Some participants thought that these 
differences were not serious; for example, 
even if the responses in operant condi- 
tioning are in the nature of a placebo 
effect, the conditioning technique may 
still have a lot to teach us about similar 
kinds of effects in psychotherapy. The 
criticism about the artificiality of operant 
conditioning experiments was answered 
by the counter-charge that the operant 
conditioning studies are no more unreal 
and divorced from reality than the psycho- 
therapy situation which can also be con- 
sidered to be artificial. The person who 
changes in the operant conditioning situa- 
tion may be the one who wants to please 
and there may be other personality corre- 
lates; nevertheless, it would be valuable 
to explore these correlates and find out 
whether they are the same for people who 
change through psychotherapy. The same 
can be said for the types of experimenters 
and therapists who can influence patients 
or subjects to change. 

One historically minded participant re- 
minded the conferees of the naive assump- 
tion perhaps related to American posi- 
tivist thinking that human behavior is 
easily changed or "conditioned." This may 
be true as far as the emission of plural 
nouns, pronouns, and the like is con- 
cerned. However, the history of modern 
psychotherapy has taught us the hard 
truth that deeply ingrained (neurotic) 



patterns of human behavior are exceed- 
ingly resistant to change. Freud found it 
necessary to postulate the repetition com- 
pulsion to account for this phenomenon, 
and a large part of the job in psycho- 
analytic therapy is devoted to breaking 
down the patient's unconscious resistances 
to change. Learning to change is easy in 
those areas in which the patient's ego has 
little need to defend itself; the difficulties, 
on the other hand, are great when change 
threatens important defensive functions. 

Values: and Snares of Clinical Inference 

Everybody thinks clinical inference is 
important, but pedantic emphasis on 
method divorced from problems has dis- 
couraged research on the inference 
process. This may expkin why research 
plans usually try to steer as clear of it as 
they can. Many participants hoped to be 
able to devise ways, for example, of find- 
ing the main themes in a vast collection 
of psychotherapy data. Of course, this 
would necessitate the use of clinical in- 
ference, since machine reduction could 
not do it. 

What people mainly worry about with 
clinical inference is the reliability prob- 
lem. Reliability studies would tell us not 
only whether independent observers could 
make the same judgments, but they would 
advance research by fostering greater ex- 
plicitness of the criteria of judgment, 
leading to the redefinition of the variables. 
However, perfectly good variables and 
concepts can be ruined by poor judges. 
One needs judges who are highly trained 
and highly motivated in order to get a 
fair test of the reliability of clinical in- 
ferences. 

The problems of clinical inference are 
encountered in the analysis of all data 
from psychotherapeutic (and diagnostic) 
interviews. The problems are especially 
evident in two tasks of psychotherapy re- 
search: (a) the construction of content- 
analysis systems, and ( b ) the assessments 
of patients leading to predictions of 
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course and outcome of treatment. Rela- 
tively little systematic research has been 
devoted to the process of clinical infer- 
ence, although one of the projects repre- 
sented at the conference has such a study 
under way (Menninger Project). 

Use of Electronic Computers for 
Data Reduction 

The machine age for psychotherapy re- 
search was visible on the horizon 
although some thought it a mirage. What 
computers can and cannot do for psycho- 
therapy research was broached; there was 
no such talk at the preceding conference. 
The discussion, however, was temperate 
the largest computer on earth could not 
find^tfie themes of a treatment, whereas 
the "soft grey computer" (the Brain) is 
welH^^nedJorjhis. Although machines 
lire not apt at finding themes, they are 
often useful for handling large masses of 
data. The suggestion was made to try to 
simulate the mental operations of the 
therapist's mind by a machine as a way 
of trying to understand better the thera- 
pist's mental operations. In this way, one 
might also explore the question of whether 
the therapist could be assisted in reaching 
the patient by the type of "spoken inputs" 
which the machine has evolved through 
its digestion of the information of the 
treatment. A possible advantage of the 
machine is its explicitness and the readi- 
ness with which its conclusions can be 
put to experimental test. 

SELECTION OF VARIABLES 

Issues concerned with the selection of 
variables were omnipresent. Not only was 
this topic one of the three major ones at 
the panel, but it was the unofficial topic 
as well in the panel on the therapist and 
the panel on change. And several of the 
papers explicitly dealt with problems per- 
taining to the selection of variables. The 
best way to deal with such a large topic 
is to apply the techniques of data reduc- 
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tion and organize the material into the 
major themes around which discussion 
centered. By way of introduction, two 
topics will be considered: (a) problems 
of data reduction and the size of units, 
and (b) neglect of content variables. The 
body of the section will be broken up into 
the usual major areas: "techniques of 
therapy," "the therapist," "the patient," 
plus a new one, "the match between pa- 
tient and therapist." 

Finding the right concepts and the right 
units is one of the basic problems of 
science; it is crucial for psychology, and 
in particular for psychotherapy research. 
It is even more important than the meas- 
urement of variables. When chemistry 
stopped looking at "odor" and "hardness," 
etc. and shifted to such units as "the re- 
activity of the substance with hydrogen 
and oxygen," a big advance was made in 
chemistry. With our shift of focus to inter- 
actional variables variables which com- 
prise not only the patient singly or the 
therapist singly, but the interaction be- 
tween them we, too, seem to be moving 
to the stage of functional units. A separate 
topic heading, Match between Patient and 
Therapist, will therefore be included. 
However, even the variables listed under 
the single headings, e.g., Therapist, are 
also conceived of in interactional terms. 

By careful listening for major themes, 
it is possible to reduce the types of gen- 
eral issues that were brought into the 
discussion of any variable to nine: (1) 
possible definitions and difficulties of 
these definitions, (2) reliability of meas- 
ures, (3) range of stimuli that influence 
the variable, (4) relationship of the vari- 
able to mental health and to the outcome 
of psychotherapy, (5) correlates and in- 
terrelations with other variables, (6) 
varieties of the variable as these show up 
within psychotherapy and within psycho- 
logical tests, (7) degree of awareness of 
the variable that is achieved by the pa- 
tient, (8) meaning or significance of the 
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variable to the patient, (9) "generativity" 
of the concept that gave rise to the vari- 
able the extent to which it opens up new 
knowledge and stimulates further research. 

Problems of Data Reduction and 
Size of Unit 

There was much interest, but some un- 
certainty, in how to go about managing 
the mountainous mass of data usual in 
psychotherapy research. The natural re- 
sponse of the naturalist when confronted 
by a complex behavior sequence is to ob- 
serve and listen quietly in order to get in 
tune, and then to classify the main con- 
cepts. Several participants advocated this 
approach to research. 

The task of data reduction from miles 
of tape or film is formidable; many dis- 
cussants suggested the reduction of the 
data to what is relevant to specific ques- 
tions. Many observed that this problem 
is no different in other fields. Every phe- 
nomenon is complex and there is always 
a question of data reduction. 

Why not, for example, simply reduce 
all the data to the main themes? There 
was considerable sympathy for this solu- 
tion, provided there was a sure way of 
identifying "main themes." There was a 
dissatisfaction with the kinds of segments 
that had been used in many process scor- 
ing systems; for example, systems in which 
the sentence is used as the unit. Such units 
are not only arbitrary, but also not laxge 
enough. We need to define for ourselves 
meaningful molecular units which are re- 
lated to treatment process and outcome 
(cf. the discussion under Process Scoring 
Systems and Clinical Inference). 

Neglect of Content Variables 

It was striking to observe that all the 
variables suggested were formal. One dis- 
cussant tried to analyze this neglect as a 
"resistance to content" on the group's part. 
Possibly a resistance was also shown in 
the rarity with which specific patients 
were mentioned at the psychotherapy con- 



ference. At the last conference there was 
a similar lack, although one of the pro- 
posed scoring systems (Leary and Gill) 
contained some content variables. How- 
ever, the present conference was probably 
the more "clinical" of the two. (This was 
partially a function of the planning in 
that a deliberate effort had been made to 
invite more "pure" clinicians to the second 
conference, since researchers and clinicians 
too often have proceeded in "splendid 
isolation," both feeling that they have 
little to contribute to each other.) 

The discussion came closest to consid- 
eration of content with the issue of the 
definition of "activity of the therapist" 
and what determines the impact and 
meaningfulness of a communication to the 
patient Some resolution of the issue was 
attempted by the conclusion that the 
therapist says something meaningful 
when the patient is not too disturbed by 
it so that he is able to "process" it. 

Treatment 

Four topics caught the attention of the 
contributors and discussants: (a) the na- 
ture of therapeutic influence upon the 
patient, (b) the effects of activity- 
inactivity upon the patient, (c) the classi- 
fication of different treatments along the 
dimension of ambiguity-structuredness, 
and (d) the spacing of therapy sessions. 

Interest in treatment techniques in- 
creased as compared to the preceding con- 
ference, possibly because researchers in 
psychotherapy have become more experi- 
enced in practicing psychotherapy and as 
they have made it an important focus of 
clinical activity. The proper spacing of 
therapy sessions is a topic of immediate 
practical concern to clinicians. While the 
clinical literature has much to say about 
it, only recently have controlled studies 
been attempted the project represented 
at this conference is the most comprehen- 
sive of these (Lorr). 

In the area of treatment techniques, as 
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well as in each of the others, the lack of 
a standard set of terms or variables was 
felt. These could help compare different 
kinds of psychotherapy with each other 
and with different interpersonal situations. 
( Some attempts to list treatment variables 
are available; e.g., Bibring (1954) and 
Luborsky etaL (1958).) 
The Nature of Therapeutic Influence: 
Manipulation vs. Growth Facilitation 

Certain words used in the conference to 
describe therapeutic action were highly 
loaded. Therapists do not like to think of 
themselves as manipulators or "control- 
lers"; they do not enjoy being compared 
with "brainwashers" or faith healers. The 
immediate stimulus for discussing the na- 
ture of therapeutic influence came from 
the injection of such words by proponents 
of the operant conditioning techniques. 

This issue has been with us for cen- 
turies. Physicians have had two schools of 
thought corresponding to the same op- 
posed concepts: one school of medicine 
conceiving of the physician's function as 
merely facilitating natural reparative func- 
tions, the other school believing that the 
physician actually cures and that he is the 
agent of cure. Some of the onus attached 
to "influence" and "manipulation" may 
derive from the bad repute in which sug- 
gestion and advice-giving as therapeutic 
techniques are held in some quarters. A 
decade ago there was a lively controversy 
about Franz Alexander's recommendations 
for "manipulation" or "regulation" of the 
transference, Alexander felt that time 
could be saved if the transference were 
only "allowed" to develop as much as 
needed for the treatment, in contrast to 
the classical position whose prime aim is 
to analyze the transference, not to "ma- 
nipulate" it. More recently, the issue was 
debated by Carl R. Rogers and B. F. 
Skinner at one of the best attended sym- 
posia held at the American Psychological 
Association meetings. Rogers took the 
view that in psychotherapy the individual 
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realizes himself by a positive striving to- 
ward growth and creativity. Skinner main- 
tained that in treatment one is manipu- 
lated. 

Most of the participants in our con- 
ference felt strongly that the language of 
conditioning, manipulation, and control 
was out of place in psychotherapy. They 
preferred to think instead of assisting 
healing potentialities, allowing a person 
to choose for himself, and to help him 
find new purposes by releasing him from 
the bonds of his biography. 

Many participants could accept partial 
resolution of the problem expressed in the 
following terms: the therapist wants to 
influence the patients toward using his 
own faculties and growing in the best pos- 
sible directions. It is recognized that the 
ways in which therapists implement this 
influence differs in different forms of 
therapy. 

Therapist Activity vs. Inactivity as a 
Technique of Change 

Discussion of this issue was stimulated 
from at least two sources: (a) the obser- 
vation reported from one project that 
expressiveness of the therapists, especially 
in the form of posture and vividness of 
communication, could be used consciously 
to show an interest in the patient and 
hence facilitate change ( Butler ) , and ( b ) 
the use in another project (Lennard) of 
the amount of speaking on the part of 
the therapist as an index of activity. 

Considerable interest was shown in the 
suggestion that activity in the form of 
expressiveness that reveals interest could 
facilitate change in the course of treat- 
ment. A number of participants took this 
idea away as one to be thought over, tried 
out, and retested. 

The tendency of information theorists 
and others to treat statements solely quan- 
titatively was questioned, The view was 
neatly expressed by Gilbert: "The mean- 
ing doesn't matter if it's only idle chatter 
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of the transcendental kind." Most discus- 
sants were convinced that without the 
meaning, words spoken have no relation- 
ship to activity-inactivity. The number of 
words uttered by the therapist is a sec- 
ondary variable and the meaningfulness 
of what he says, the impact upon the 
patient, becomes the primary variable. 
(Recent studies have included aspects of 
the therapist's messages beside the number 
of words or the type of message, e.g., "in- 
terpretation," and "reflection of feeling." 
This is a typical example of an increment 
of sophistication among researchers over 
the past decade or two. ) 

Ambiguity vs. Structure of the 
Treatment 

The participants were intrigued with 
this concept; it seemed one that had been 
insufficiently exploited. One of the panels 
was stimulated to a definition of the vari- 
able as well as a listing of the main quali- 
ties of the treatment that contribute to it. 
They defined it as "The qualities of the 
treatment situation which maximize or 
minimize the variability of patient be- 
havior." They listed the following nine 
influences upon this variable: (1) type of 
task, (2) type of procedure, (3) patient- 
therapist relationship, (4) type of content 
expected, ( 5 ) anxiety level of the patient, 

(6) activity-passivity of the therapist, 

(7) restriction by the therapist of the 
variety of the statements, (8) definition 
of the therapist's tasks and goals, and (9) 
definition of the therapist in the eyes of 
the patient. 

Like most variables, ambiguity-structure 
has been in the literature for some time 
(e.g., Ekstein, 1952). Clinicians have be- 
lieved for a long time that the more struc- 
ture, the less transference development, 
and the less structure, the more transfer- 
ence potential of the treatment. There was 
general recognition that just as there is no 
one formula for effective therapist be- 
havior, so there are some patients who 
need ambiguity and a nonexpressive 



therapist, while others need the opposite 
qualities of the dimension. 

Therapist 

At the first conference, interest was ex- 
pressed in a fuller description of the 
therapist. At this conference he was ele- 
vated to the status of a formal position on 
the program. Still, he proved to be a hard 
one to get to know. 

A review of the brief history of the 
modern era of psychotherapy reveals that 
Freud in his contributions at first paid 
little attention to the therapist. Then, in 
1910 he introduced the concept of the 
countertransference which for several 
decades was the focus of interest in the 
therapist's personality. In this conception, 
the therapist's personality was viewed as 
a possible source of interference with the 
progress of psychotherapy, and the goal 
was to minimize such interferences. The 
royal road to this objective was the per- 
sonal analysis of the therapist, which was 
intended to make him a standard instru- 
ment, maximally objective and sensitive 
to the patient's and his own transference 
maneuvers. It was implied but never 
made explicit (except in tangential refer- 
ences) that the therapist was a mature, 
dedicated person who could serve the pa- 
tient as a model for healthy identification. 
Thus, the therapist's technical contribu- 
tion (primarily his interpretive skill) 
came to occupy a position of foremost im- 
portance for the outcome of psycho- 
therapy. 

During the last decade or two, the 
human relationship aspects of psycho- 
therapy have come in for more explicit 
stress in the literature. In fact, some 
writers propose that the therapist's per- 
sonality is more important than any tech- 
nique he might use. Some go so far as to 
question whether technique is important 
at all; they suggest that it only matters 
whether the "right" patient encounters the 
"right" therapist at the "right" time. The 



318 

congruence and mutual impact of the 
patient and therapist on each other re- 
ceived special attention during the con- 
ference. Much of the panel on the Thera- 
pist was devoted to thinking of variables 
of an interactional sort involving both 
therapist and patient for example, "de- 
pendency of the patient on the therapist," 
"comparative value systems of the thera- 
pist and patient," "comparative level of 
anxiety of therapist and patient," "thera- 
pist's capacity to like the patient," "thera- 
pist's willingness to allow the patient to 
grow," etc. 

The Basic Question: How Does the 
Therapist Influence the Patient? 

The basic question was central to many 
issues, even when the focus was not spe- 
cifically upon the therapist. (See the dis- 
cussion earlier on "the nature of treatment 
influence.") The issue has sometimes been 
put in terms of what the therapist does vs. 
what he is. Of prime importance, of 
course, is how the patient interprets the 
therapist, both cognitively and emotional- 
ly. For example, at different times and in 
different combinations, the therapist may 
be experienced as a reasonable father, a 
loving mother, a religious figure, a serious 
therapist, an inspired healer, a charismatic 
leader, or as a reinforcement machine that 
has been programed to emit certain re- 
sponses. Can the therapist's activities be 
reduced to operations and roles which he 
shares with other members of the culture 
(for example, parents, teachers, religious 
leaders, or brainwashers)? These were 
some of the questions which arose in 
many guises at the conference. At least in 
the context of psychotherapy research, 
such questions have rarely been squarely 
faced. 

Personal Qualities of the Therapist 

As might be expected, research is more 
plentiful on those personality character- 
istics which can be studied quantitatively 
by available research techniques.^ Since 
there is often an inverse relationship T>e- 
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tween the importance of _a L yariable and its 
Amenability to objective research, it is not 
surprising that more superficial character- 
istics have been more extensively studied 
than more Important^onesr^or example, 
it is easier to count the therapist's use of 
interpretations vs. "reflections of feeling," 
and the number of each used in a given 
hour, than it is to judge the quality of a 
particular verbal intervention, the thera- 
pist's attitude in making it, and its impact 
upon the patient. However, there is prog- 
ress to point to. Fairly extensive data have 
been reported in the literature on differ- 
ences between more and less experienced 
therapists, and between therapists adher- 
ing to various theoretical orientations. "We 
have also learned more about the effects 
of the therapist's warmth, personal con- 
flicts, and anxiety level on the therapist's 
judgments of the patient-therapist inter- 
action. 

There was considerable interest in dif- 
ferences among therapists who were more 
vs. less successful in treating schizophrenic 
patients. (The topic was stimulated by the 
paper submitted by Dr. Barbara Betz.) 
Apparently the better therapists succeeded 
in fostering a trusting relationship with 
their patients. A natural question came 
next: Why has it been so hard to establish 
equally identifiable qualities for therapists' 
who treat neurotic patients? Symposium 
participants suggested as possible explana- 
tions: (a) the criterion for change for 
schizophrenic patients who recover is 
quite gross, and therefore easier to estab- 
lish than it is for neurotic patients, and 
(&) the anxiety stirred up in some thera- 
pists by empathizing with schizophrenics 
is very great, and some therapists find this 
anxiety almost intolerable. Astonishment 
was expressed about the great difficulty of 
retraining the less effective therapists to 
become more effective therapists (with 
schizophrenics ) . 

Such characteristics as the therapist's 
dedication, faith, integrity, honesty, and 
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firm belief in the efficacy of his proce- 
dures were mentioned as crucial for 
therapeutic progress, but have so far been 
resistant to investigation. The therapist's 
system of values and his degree of au- 
thoritarianism are important variables 
which have recently been included in re- 
search projects. The therapist's personality 
is presumably intertwined also with his 
theoretical orientation, his therapeutic 
goals, his techniques, and the kinds of pa- 
tients he prefers. Recently, such variables 
as social class, religion, age, sex, and ethnic 
group membership have come in for re- 
search attention which has pointed up 
their relevance in a striking fashion (e.g., 
Hollingshead & Redlich, 1958). 

Therapists "Resonance" to the Patients 
Personality 

The therapist's response to the qualities 
of the patient (including sociocultural 
characteristics) might further or impede 
the therapy. Diagnostic and prognostic 
judgments are influenced by the thera- 
pist's attitudes toward the patient. In ex- 
treme cases, the therapist's diagnoses or 
negative attitudes toward the patient act 
as a self-fulfilling prophecy, resulting in 
therapeutic failure. 

The therapist must be capable of com- 
munication which is profoundly meaning- 
ful to the patient, and his expressiveness 
must create a responsive resonance in him. 
Patient and therapist must meet each 
other's expectations at least in part if 
change is to occur. As one participant put 
it, "the patient's capacity for improvement 
may lie in his ability to be emotionally 
aroused in certain ways by the treatment 
he receives." Freud (1935) in describing 
the dynamics of the transference neurosis, 
made a similar point: "The outcome in 
this struggle (between the repressive and 
expressive forces in the patient) is not 
decided by his intellectual insight it is 
neither strong enough nor free enough to 
accomplish such a thing but solely by 
his relationship to the physician" (p. 387; 
our italics). 



The therapist communicates both in- 
tellectually and affectively with the pa- 
tient, and the patient responds to the 
messages both cognitively and affectively. 
The cognitive component serves to re- 
structure the patient's affective responses 
in a new framework. The learning is 
mediated mainly by linguistic communi- 
cation: the more the consensus reached 
between patient and therapist, the more 
the possibility of a successful outcome to 
the treatment. ( See also the section below, 
The Match between Patient and Thera- 
pist.) 

Mental Processes of the Therapist 

Long before the present-day type of 
research scientist in psychotherapy came 
along, the therapist was faced with the 
job of ordering the data emerging from 
his interaction with the patient. He had 
to be able to listen attentively or with 
"free floating attention," to draw infer- 
ences and incorporate these in his com- 
munications to the patient. It was partly 
through this process that theories of psy- 
chotherapy have evolved. 

The scientist is keenly interested in 
how the clinician's mental processes work 
in arriving at his communications to the 
patient. This topic has been repeatedly 
suggested as a potentially significant 
frontier for psychotherapy research, but, 
with few exceptions, very little research 
has been done so far. (David Shakow sug- 
gested a method years ago as did Franz 
Alexander in his current psychotherapy 
research project.) The relentless researcher 
who wishes to ask such potentially em- 
barrassing questions as whether independ- 
ent observers can make identical observa- 
tions and draw similar inferences has 
therefore thus far been frustrated. How- 
ever, some research studies are getting 
under way in this area. 

Patient 

The problems of establishing criteria 
for change captured the attention and in- 
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terest of the participants more than any 
other topic in this area. Only a few specific 
variables about the patient were discussed 
at length. 

Although the role of the therapist was 
stressed in this conference, there was no 
implication that this was meant to depre- 
ciate the importance of the patient and 
his personality. At the last conference, one 
investigator stated that practically all the 
variance in outcome level was a function 
of variance within the patient at the be- 
ginning of the treatment. At the present 
conference, one contribution was thought 
to have a somewhat similar implication. 
The initial level of rated health-sickness 
was reported to correlate highly with the 
termination level of health-sickness ob- 
tained. This, of course, says nothing about 
the role of the therapist, but it does em- 
phasize the patient's initial state as a 
significant factor in outcome. 

A perennial question came up about 
which therapists at times feel overoptimis- 
tic or overpessimistic: How drastically 
can treatment change an individual? This 
question gained meaning in the context 
of discussion of potential dangers in thera- 
peutic influence as an instrument for 
manipulation of people. 

Criteria for Change 

a. Lack of Correlation among Criteria 
from Therapist, Patient, and Other 
Sources. Here is an opportunity for re- 
search. The lack of correlation among 
criterion measures has thwarted research- 
ers for some time. Rogers was probably 
one of the first to make this observation 
on the basis of his study at the Counseling 
Center, University of Chicago. The lack of 
correlation among criteria was brought up 
in the present conference, but no satisfac- 
tory discussion nor cogent explanations 
developed. (One participant observed, 
however, on the basis of a study he had 
recently completed, that observer, thera- 
pist, and diagnostician actually agreed in 
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their judgments if one correlated the self 
factors.) 

b. Necessity for More than Single (Spe- 
cific or Global) Measures of Change. In 
view of the complexity of the concept of 
mental health and the lack of correlation 
among criteria, the sophisticated solution 
to get a rounded picture of change is to 
use more than one rater and take into ac- 
count the view of several observers. 
Among the criteria which have to be con- 
sidered are those listed by Zax and Klein 
(I960): (a) intratherapy measures (the 
verbal productions of the patient), (b) 
therapist ratings, and (c) behavioral cri- 
teria outside the treatment relationship. 
At the present conference, several partici- 
pants stressed the worthwhileness of the 
last of these criteria, which too often have 
been neglected. 

No single measure of change, even 
when repeated on the patient over time, 
is sufficient, since any change may involve 
altered interactions with other areas of 
the personality and with the environment 
(Luborsky & Schimek, 1962.) Several 
specific criteria were utilized in the 
Phipps Clinic project reported at the last 
conference; for example, "discomfort" and 
"social ineffectiveness" (and Lorr is de- 
veloping scales for separate criteria). 

Global measures of change have been 
widely used, such as ratings of "improve- 
ment," "mental health," and "success" in 
treatment. They have a rule-of-thumb 
value in broad surveys of psychotherapy 
results, but should never be used singly. 
This recommendation was contained in a 
number of contributions at the confer- 
ence; for example, the global Health- 
Sickness Rating Scale of the Menninger 
Foundation Project is more complete 
when used together with the ratings of 
the seven specific criteria which compose 
it. 

c. Need for Better Measures of Out- 
come. Scales or measures which could be 
used both nationally and across projects 
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were recommended by several conferees. 
Also tools are needed for measuring short- 
term outcome or changes. Measures of 
outcome should be of all three types sug- 
gested by Zax and Klein (I960). One 
conferee expressed the sentiment, which 
was shared by others, that we need meas- 
ures of strength as well as measures of 
illness. 

The most consistently voiced sugges- 
tion for implementing the recommenda- 
tions was to hold future meetings (pref- 
erably of smaller working groups) to 
examine the variety of evaluation tech- 
niques. One participant believed that the 
development of these measures would 
probably come about by natural growth. 
Another school of thought, probably the 
largest one, held that there are too many 
measures already and that we need now a 
theory to organize the measures and to 
apply statistical techniques designed to 
reduce redundancy. One way would con- 
sist in running correlations between these 
measures and discarding overlapping ones. 
Areas could be found in which there are 
no measures, and these gaps could be 
filled. One participant objected, however, 
that it may not be wise at this stage to 
throw out any measures; rather we should 
allow for redundancy of instruments, vari- 
ables, and approaches. The conciliatory 
point was made that criteria depend on 
the purpose of the treatment; as the aims 
vary, so might the criteria one would 
select. 

d. The Best Level of Abstraction for 
Criteria. This question held a fascination 
for several participants. Impetus to discuss 
it came from the interesting data pre- 
sented by one of the contributors (Shlien). 
These data showed that an individual re- 
sponds in approximately the same way in 
terms of his own self-ideal ratio whether 
he is presented with specific items in the 
form of verbal questionnaire items or 
with an over-all question about his self 
and ideal self, put to him via a little 
gadget that he simply adjusts to demon- 



strate the relative positions of his self and 
ideal self concept. An intense discussion 
followed on the definition of abstract- 
concrete and how the designation "ab- 
stract" applied to the visual demonstra- 
tion. The definition of abstract was given 
by the contributor as the capacity of a 
variable to be conceptualized and raised 
above specific content. After the fascina- 
tion came questions. One participant 
wondered whether the criterion really be- 
comes less important and less meaningful 
as it becomes more abstract. Another par- 
ticipant concluded that different levels of 
abstraction are fitting for differing re- 
search purposes. 

The Nature of Change: Reduction of 
Illness or Growth of Personality P 

The discussion on this issue was quite 
similar to the one on the nature of thera- 
peutic influence is the influence upon a 
patient a product of the therapist's ma- 
nipulation or the result of conditions 
which facilitate the patient's own growth 
potentialities? There was considerable 
consensus about the conclusion that with 
reduction of illness there is usually re- 
sumption of growth. 

Logically and inevitably this topic 
veered into the always-near-the-surface 
issue of the nature of mental health. It is 
difficult to list the criteria for mental 
health, although this has been attempted 
increasingly in recent years with some 
success by Erikson, Jahoda, Hartmann, 
and others, 

Principal Patient Variables Discussed 
at the Conference 

The value of diagnostic variables was 
considered briefly. Finding such categories 
has been a perennial goal and a perennial 
dissatisfaction. Clinicians tend to feel that 
current diagnostic concepts are not very 
good but are much better than nothing. 
Whitehead said, in a different context, 
"Nature doesn't come as clean as we can 
think it." Clinicians and others are nag- 
gingly aware that our concepts are too 
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"dean," and would be more satisfied with 
"unwashed" ones corresponding more 
closely to nature. Much of the discussion 
on diagnosis centered on the label "schizo- 
phrenia." It was pointed out that certain 
themes uniformly go along with each 
diagnosis. It was also commented that over 
the years, with the lessening of the stigma 
attached to the term, more patients are 
classified in the category "schizophrenia." 

The following variables were men- 
tioned: Self /Self -Ideal Ratio, Anxiety, 
Anxiety Tolerance, Patient's Participa- 
tion, Perception of the Therapeutic Field, 
Transference Pattern, Perception of Self, 
and Patient's and Therapist's View of 
Treatment Results. Since only the first 
three came in for more than cursory atten- 
tion, they will be reviewed here principal- 
ly as examples of the types of problems 
that come up in discussions about specific 
variables. 

Self /Self -Ideal Ratio. The concept of 
self /self -ideal ratio was brought into the 
discussion as an example of the best level 
of abstraction for a criterion. Concern 
was expressed about the composition of 
the self/self -ideal ratio. One discussant 
considered that since self-ideal descrip- 
tions are similar, the variance must come 
from the self description. Concerning the 
correlates of the self/self-ideal ratio, 
anxiety was suggested as a likely possi- 
bility. One participant who had done con- 
siderable work with self/self -ideal ratios, 
listed several correlates. His findings sug- 
gested that people who are extreme in 
their self/self -ideal correlation are among 
the ones who are the difficult cases in 
treatment. Patients with high self/self- 
ideal ratios include among them the more 
maladjusted. After a variety of questions 
had been raised about the self/self-ideal 
ratio, one proponent of the variable re- 
plied that these questions raised were 
good ones but were general and applied 
equally to any other criterion of change, 
and not uniquely to self/self-ideal ratios. 



Anxiety and Anxiety Tolerance. Despite 
considerable research on "anxiety," the 
term still resists simple definition. One of 
the difficulties with the definition of many 
variables, and particularly this one, attends 
the attempt to mix "data language" (behav- 
ioral language) and "concept language." 
A participant who had spent years trying 
to analyze the concept, concluded that 
anxiety has to be considered as a process 
rather than an entity open to observation 
and measurement. Despite difficulties in 
definition, other participants argued that 
one could get useful global reports of 
magnitude of "anxiety" from the patient. 

Several investigators reported instances 
in which anxiety measures failed to corre- 
late with each other. Much of the difficulty 
was attributed to inadequate specification 
of the time period for which the person 
is supposed to make a judgment about his 
anxiety level. Since anxiety varies con- 
siderably over time, the question to the 
self-rater must include an explicit time 
specification, otherwise considerable un- 
reliability can be reaped. The topic or ac- 
tivity engendering anxiety should also be 
specified. It was recognized that anxiety 
scales may not work in one situation but 
work in another. This implies that no one 
definition is best; different ones must be 
tried in different situations. For instance, 
the example was given of the Taylor 
Anxiety Scale which correlates with 
change in palmar sweat but not with level 
of palmar sweat. 

The same variety of vantage points 
which we described as applying to judg- 
ments of any criterion of treatment out- 
come and treatment can also be applied 
to judgments of anxiety: judgments can 
be made by the patient, the therapist, or 
by an observer on the basis of psycho- 
logical tests, process recordings of treat- 
ment, observations of the patient in family 
life and at work. 

One contributor (Luborsky) reported 
a positive correktion between measures 
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of initial anxiety level and of change in 
the course of psychotherapy. However, 
this correlation may not always be posi- 
tive. Two reasons for this variation were 
put forward: (1) Following therapy, the 
patient often deliberately exposes himself 
to anxiety-provoking situations which 
previously he may have avoided. ( 2 ) Pa- 
tients whose mental health is rated high 
tend to show a higher correlation between 
level of anxiety and amount of change 
than patients whose initial rating of 
mental health is low. Ratings of the pa- 
tient's anxiety level should not be con- 
sidered by themselves; rather, they must 
be judged along with measures of anxiety 
tolerance or "the capacity to use anxiety 
as a danger signal" as opposed to being 
overwhelmed by it (Siegal and Rosen). 
Because of these considerations future 
studies of anxiety in relation to outcome 
will probably produce varying results, 
since the population samples themselves 
will differ in terms of anxiety tolerance. 

Anxiety is central to treatment; the con- 
ferees were almost unanimous on this 
point. Therefore, it is important to 
achieve better definitions and more knowl- 
edge of how judgments can be made of 
anxiety and its form varieties as they ap- 
pear during treatment. (The old "Dis- 
comfort-Relief quotient" was getting at 
one aspect of anxiety level in the course 
of psychotherapy.) So far, in the reports 
in this conference, it was judged mainly 
from evaluation interviews and psycho- 
logical tests. In addition to these prob- 
lems, the patient's awareness of his own 
anxiety and its meaning to him must be 
taken into consideration. 

Match between Patient and Therapist 

Matching is crucial in marriage; so may 
be the match between patient and thera- 
pist in therapy. So far we know more 
about the first than the second. We know 
less about those characteristics of the 
therapist promoting a beneficial relation- 



ship than we know about the character- 
istics of the patient which make him a 
good candidate for psychotherapy. 

There has been an increasing amount 
of research on this problem. One study 
(Counseling Center, University of Chi- 
cago) has separated three kinds of pa- 
tients: those with whom both experienced 
and inexperienced therapists have equally 
fair success; those with whom experi- 
enced therapists do well; and those with 
whom inexperienced therapists do poorly. 
These patients are characterized by differ- 
ent styles of expression. In the operant 
conditioning literature, a study found that 
compatible need systems underlie the most 
effective matching (Sapolsky, I960). One 
participant reported a situation in which 
residents, when given the opportunity to 
choose their own patients, tended to select 
patients who were young adults, who had 
higher socioeconomic status than other 
patients, who had lower scores on the F 
scale, who wanted treatment more than 
other patients did, and who were less anti- 
intraceptive. 

The problem of patient-therapist com- 
patibility is described in a review of psy- 
chotherapy (Strupp, 1962) as an area in 
which more work is currently being done. 
Among the patients who are considered 
good prognostic risks are those who are 
very much like the preferred patients 
chosen by the residents: they are "y oun S> 
attractive, well-educated, members of the 
upper-middle class, possessing a high de- 
gree of ego strength, some anxiety which 
impels them to seek help, no seriously 
disabling neurotic symptoms, relative ab- 
sence of deep characterological distortions 
and strong secondary gains, willingness 
to talk about their difficulties, ability 
to communicate well, some skill in the 
social vocational area, and a value system 
rektively congruent with that of the 
therapist; such patients also tend to re- 
main in therapy, profit from it, and evoke 
the therapist's best efforts." These char- 



324 



RESEARCH IN PSYCHOTHERAPY 



acteristics may actually contribute to a 
better outcome of psychotherapy, but fur- 
ther research needs to be done to establish 
them. 

Life Situation 
(Extra-treatment Environment] 

The consensus was that this conference 
gave greater recognition to social factors 
than the last one. The last conference 
report, in fact, included no major heading 
for this category. As a mark of its newer 
status, it now rates a heading of its own. 

Psychotherapy researchers were admon- 
ished by their fellows: they stay in the 
office too much; they should get out and 
see how the patient lives. So far, their 
knowledge about patients has come either 
directly from the treatment or from diag- 
nostic tests. Yet the ultimate test of the 
outcome of treatment is the manner in 
which the patient actually changes his 
way of living outside the treatment. 



EPILOGUE 

We shall comment on two main topics: 
the rate of development in psychotherapy 
research, and new areas showing promise 
of growth. 

Rate of Advance in Psychotherapy 
Research 

What we cannot reach flying we must 

reach limping 

The book tells us it is no sin to limp. 

Freud quoting Riickert's 
translation of al-Hariri 

"Slow" is the adjective used most com- 
monly by reviewers of psychotherapy re- 
search in the Annual Review of Psychol- 
ogy for describing the rate of advance. 
Reviewers usually recommend a five-year 
interval between reviews as being more 
suitable than the current annual interval. 



We will now take up some of the obstacles 
to progress 2 ; by identifying the obstacles, 
we believe it should be easier to cope 
with them. 

Problem of Building on Other's Work 

Psychological research generally has 
tended to be insufficiently additive. Re- 
search people often find it hard to keep 
informed of related work done on the 
same site and elsewhere, and therefore do 
not build upon each other's foundations. 
(There are notable contemporary efforts 
to counteract this trend: the Mental 
Health Research Institute at the Univer- 
sity of Michigan, the National Institute 
of Mental Health in Bethesda, and the 
Research Center for Mental Health at 
New York University.) The problem is 
compounded in those psychological fields 
in which definitive research studies are 
hardest to perform. Naturally, when an- 
other project seems so shaky, why build 
on it? Psychotherapy research unfortu- 
nately is an example of such a field. 

The Second Conference on Research in 
Psychotherapy and this book were aimed 
at repairing this defect by providing inter- 
change and reviewing a representative 
sample of current work. Almost every par- 
ticipant responding to the postconference 
questionnaire wrote in that "knowledge 
of others* work" and "increased acquaint- 
ance with people who were doing work in 
the same area" were the outstanding gains 
of the conference. Still, many participants 
were concerned about the problem of in- 
sufficient additiveness. Some urged con- 
ferences focused around even more specific 
topics and working over a much longer 
time period. 

2 The listing covers outstanding obstacles to 
advance in psychotherapy research; it is not 
intended to be exhaustive. Obviously advance in 
this area is also limited by the obstacles to 
development of psychology. Both therapeutic 
and practical obstacles have been listed by 
Rapaport (I960, pp. 137444). 
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Problem of Maintaining Historical 
Perspective 

Psychotherapy research cannot look 
back on a long history. Freud began sci- 
entific studies in this area about 65 years 
ago with his new observations, theory, 
and technique. The quantitative and ex- 
perimental approach is only about 20 
years old (Frank, 1961). Its initiation 
points spark off from the well-known 
follow-up studies in Berlin, London, Chi- 
cago, and Topeka; and from the prodi- 
gious and continuing work of Rogers and 
his students. We can anticipate much 
growth, but growth will take time. 

Problem of Discouragement 

It took temerity to hope for a second 
conference matching the enthusiasm and 
contributions of the first. Each of us had 
psychological obstacles against coming 
with the proper spirit: the hesitation at 
disruption of work schedules by another 
conference; the discordance of opening 
our minds to other points of view; the 
unregenerate wish for the new and re- 
markable to happen (just as we some- 
times wish for improbable change in our 
patients) for the discovery jumping us 
forward qualitatively. Clearly, the par- 
ticipants had to call upon their reality 
testing to rein in these feelings. A rec- 
ommended attitude for psychotherapy 
researchers (attributed to Zen) is: "Work 
as though everything depended upon it, 
but don't care about the result." 

It is too much to expect emergent ad- 
vances resulting from one or two confer- 
ences. A conference can simply fulfill its 
stated aim of facilitation of interchange 
and therefore be satisfying. It can pull 
together a set of original papers represen- 
tative of work in the field. It can even, as 
this one also did, lead to the planning of 
new research projects by people who al- 
most certainly would not have thought of 
collaborating. One participant expressed 
his gains: "It gave me the opportunity to 



meet others in the field and to learn: (a) 
that differences in professional terminol- 
ogy need not block communication; (&) 
that some supposed differences between 
analysts, psychologists, etc. are more myth- 
ological than otherwise (even though un- 
fortunately they may be self -perpetuating) ; 
and ( c) that serious working contact with 
others can renew and widen my own 
interests." 

All three working groups emerged at 
day's end frustrated at not being able to 
digest the assigned topics more adequate- 
ly. The topics had been too big to assimi- 
late in the allotted time. These feelings, 
they suggested, might have been dimin- 
ished by setting up smaller working 
groups, by building more homogeneity of 
interest into each group, by providing 
even better leadership and more focused 
topics; but they could not have been 
eliminated. The field grows hard and diffi- 
cult problems are hard to avoid and harder 
to face. 

Problem of Commitment of Researchers 

If it takes courage to think of handling 
the problems in psychotherapy research, 
it takes tenacity to commit a major por- 
tion of one's productive energies to the 
field and stick with it. But involvement 
in investigation is often fueled by deeper 
motives than the prospect of easy prog- 
ress. This can be a blessing, as the history 
of science shows. Nevertheless, a discon- 
certing discrepancy exists between the 
large number of psychologists who say 
they are interested in psychotherapy as a 
clinical and research activity and the small 
group who invests significant efforts in 
psychotherapy research. (According to 
the Directory of The American Psycho- 
logical Association, interest in psycho- 
therapy research is listed by approximately 
25% of all members.) An even smaller 
group remains firmly committed to a re- 
search career in psychotherapy; shifts in 
commitment have occurred even within 
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the group which participated in the last 
psychotherapy conference. 

The commitment problem is further 
burdened by the time it typically takes to 
carry through a project one participant 
estimated that ten years of dogged work 
was about par for working out even a 
small research question in the area. 
Length of commitment is also in part a 
function of opportunity. Such research 
takes money, and lots of it, over a long 
time period. 

Problem of Background and Training 

Investigators must be well trained in 
psychotherapy and quantitative methods. 
AsRapaport (I960) pointed out, we can- 
not rely solely on knowledge of quantita- 
tive method; we also need sophistication 
in psychology. We cannot use simple 
quantifications from our data without 
understanding the processes determining 
them. One prime example is using quan- 
titative measures, such as single scores 
from psychological tests or Q sorts with- 
out appreciating the processes producing 
them. 

Participants attending both conferences 
remarked that the second was less tense; 
the spirit seemed less defensive and more 
accepting. Much of this change may have 
followed from the fact that there were 
more people who knew each other and 
had been at the first conference. Some of 
this change may have been caused by par- 
ticipants' greater sophistication about the 
variety of therapeutic techniques and 
their own greater immersion in them. The 
greater interest of this conference in 
treatment techniques may have had the 
same root. 

Problems of Method 

Researchers have been consistently con- 
cerned with problems of method: Bren- 
man et al. ( 1947 ) , Bronner et al. ( 1949) > 
Ezriel (1951), Edwards and Cronbach 
(1952), Butler (1953),Rodnick (1953), 
Bordin et al. (1954), Rosenzweig 
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(1954), Watterson (1954), Schafer 
(1955), Leary and Harvey (1956), 
Strupp ( I960) , and Sargent ( 1961 ) . The 
section under Method repeats some of the 
issues in these publications. Together 
they make clear that we do not yet have 
the conceptual tools and the standardized 
measures to carry us forward faster: for 
the present we must persevere with what 
tools we have. 

Growing Edges of Psychotherapy 



The diversity and complexity of the 
researches in the field of psychotherapy 
make it easy to miss the growing patches 
in the terrain, or to mistake undergrowth 
for new growth. Our listing of such new 
or continuing growth spots derives from 
participants' expressions of opinion in the 
conference and in the postconference 
questionnaire. There cannot be unanimity 
about the worth of new ideas; we have 
included those which, at least some of the 
participants believed, promised significant 
advance. All change is not progress, but 
in a field at an early developmental stage, 
many beginnings are a good sign. 

1. Quasi-therapeutic Analogues and 
Experiments Reproducing Ingredients of 
Psychotherapy. The verbal (operant) 
conditioning or social reinforcement 
studies attracted considerable conference 
attention. These studies suggested some 
interesting research questions: Can we 
identify the kinds of patients who respond 
well to social reinforcement in an experi- 
mental situation? Are they different, or 
how are they different from those who 
respond well in the psychotherapy situa- 
tion? Why do some experimenters seem 
better able to get positive results than 
others? How can we identify the effective 
qualities of these experimenters? 

It seems surprising at first that so much 
interest was stirred up in this area of 
research which was not unknown to the 
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conferees before their coming to the con- 
ference. Possibly the introduction into a 
discussion of a controversial and provoca- 
tive idea attracts much pro and con dis- 
cussion regardless of the idea's merit. 
Some of the interest may be seen as a 
flight from tolerance of ambiguity; much 
of it may be the scientific mind's usual 
search for reduction of complexity. 

New film techniques for standardized 
presentation of therapeutic situations 
have yielded interesting results and prom- 
ise more to come. 

Considerable productive work has re- 
cently been done in comparing placebo 
effects with effects of psychotherapy. 

2. Studies of Therapists' Mental Opera- 
tions. Examining the therapist's working 
mental operations his hypotheses and 
feelings as he listens to the patient has 
been suggested before; it now appears that 
workable ways will be developed for 
studying this problem systematically. 

3. Analysis of Factors Influencing Free 
Associations. Several researchers are begin- 
ning intensive studies of free associations. 
Although the free association technique 
has a central place in psychoanalytic treat- 
ment, researchers, even psychotherapy re- 
searchers, have neglected it. (An excep- 
tion is Colby, I960.) It is astonishing 
how little research has been conducted 
upon and with this technique which is 
such a rich source for the study of intra- 
and interpersonal dynamics. At most 
American universities, Janis (1958) ob- 
served, "psychoanalytically oriented" has 
come to mean merely some knowledge of 
the "theoretical superstructure" without 
experience with the "empirical founda- 
tions," especially the free-association in- 
terview, since training in the free-asso- 
ciation technique as a research tool is hard 
to come by. The recent beginnings of 
research are inspired by increased inter- 
est in psychoanalytic theory and an effort 
to comprehend the clinical phenomena 



confronted by the therapist in his daily 
work. 

4> Improved Studies of Outcome and 
Outcome Criteria. Recurrent complaints 
about the paucity of adequate studies of 
psychotherapy results obscure the fact 
that significant developments have oc- 
curred. In the past ten years, several sys- 
tematic and closely controlled studies of 
the outcome of psychotherapy have been 
completed or are under way (cf. the work 
of Rogers, Snyder, Phipps Clinic, VA 
Mental Hygiene clinics, and Menninger 
Foundation). These studies have given us 
(or promise to give us) much more than 
the studies of the past, based upon global 
ratings of "improvement," which Eysenck 
singled out for attack. 

We still need better criteria of outcome 
this was one of the most persistent sug- 
gestions at the conference. Many urged 
the formation of a committee charged 
with working out this problem. 

5. The Match between Patient and 
Therapist. New evidence has recently 
been obtained on the characteristics of 
the patient and the therapist which may 
be responsible for their getting together 
and working together productively. The 
well-known work of Hollingshead and 
Redlich (1958) is one of the nearest 
things to a breakthrough in recent years; 
it showed that social class membership of 
patient and therapist play a part in the 
establishing and prospering of the 
patient-therapist match. 

Therapists have many other expecta- 
tions about the attributes which will make 
a patient a "good" patient as we described 
above. New work is getting under way on 
the "career" of the patient. In it, the kinds 
of factors determining the patient's ac- 
ceptance into treatment by the institution 
as well as by the therapist are being 
scrutinized (Levinson). 

6, Expressive Behavior of the Thera- 
pist. One aspect of expressive behavior 
which received most attention at the con- 
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ference was the therapist's attention and 
interest in the patient. A number of in- 
vestigators considered that posture and 
other expressive behavior which are inter- 
preted by the patient as conveying inter- 
est in him, improve the results of treat- 
ment (e.g., the University of Chicago 
group). Research developments in the 
area of expressive behavior in psycho- 
therapy (kinesics) are increasing (e.g., 
Pittenger, Dittmann, Scheflen, and Bird- 
wistell) but were not adequately repre- 
sented at the conference. 

7. The Role of the Computer in Psy- 
chotherapy Research. More individuals 
are trying out computers, not only for 
more complicated data reduction but for 
attempts to simulate mental processes. 
However, enthusiasm is being tempered 
by the recognition that computers are dull 
at making clinical inferences and are no 
substitute for the scientist's or the clini- 
cian's thinking. 

8. The Role of Qualities of Affect and 
the Experiencing of Affect in Relation to 
Change. Both at the last conference and 
at the present one, this area was con- 
sidered both basic and promising. This 
belief was based on the old but widely 
and firmly held hypothesis that in order 
to change, the patient must learn to ex- 
perience and be able to tolerate the appro- 
priate affect. 

9. New Scoring Systems for Psycho- 
therapy Process. We are still in a neces- 
sary "do-it-yourself" stage, where every- 
one constructs his own system. Develop- 
ment of new process scoring schemes 
individually tailored to the researcher's 
theory and problem has been constant. 
Many of them work well for their specific 
purposes. So far, none of these have been 
used widely. Many investigators advocate 
the application of scoring systems across 
therapies and different types of patients. 

10. New Sound Film Records of Psy- 
chotherapy and Psychoanalysis. In the 
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past five to ten years technical problems 
of obtaining sound film records have been 
largely solved. Several such records are 
being made (e.g., by Shakow et al., Hag- 
gard, Alexander, and others). The next 
phase to be faced is the solution of the 
technical problems of analyzing these 
data. Cohen and Cohen (1961) give a 
first-hand account of a venture into the 
analysis of samples of the first hours of a 
long-term filmed psychotherapy. 

11. Conceptual Analyses of the "Do- 
mains" of Psychotherapy. Recently, a 
number of contributions have appeared 
whose major focus was upon deciding 
which concepts are best to work with and 
then dividing up the territory to be cov- 
ered (e.g., Levinson; Wallerstein et al., 
1956). It remains for these writers and 
their colleagues to make good on these 
promissory notes. This kind of survey can 
be important in providing guides for 
future crucial research. 

These are eleven spots in which to look 
for growth. Psychotherapy is a young 
discipline, although it has had a long 
tradition as an unformulated clinical art. 
The quantitative (and experimental) ap- 
proach to research in psychotherapy is 
even newer. We believe it has a great 
potential contribution to make to clinical 
knowledge. Increasingly, researchers in 
this area represent a combined sophistica- 
tion in both clinical and quantitative ap- 
proaches. These individuals are the ones 
most likely to succeed in fulfilling the 
potential. As the two research conferences 
have demonstrated, the new researcher is 
already playing a notable role in the de- 
velopment of the field. 
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reliability and validity, 245-247 
Relationship (see Interaction between patient 

and psychotherapist) 
Result of psychotherapy (see Outcome studies 

of psychotherapy) 
Role expectancies 
patient, 242 
psychotherapist, 14-15 

Schizophrenia, 41-42, 55-57, 105 
diagnosis, 102, 105 
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treated by psychotherapists with different 
personal qualities, 44-45, 52, 318-319 
Scoring systems (see Process scoring systems) 
Selection for psychotherapy (see Patient) 
Self -actualization (see Patient) 
Self/Self-ideal self ratio, 146-147, 161, 167, 

322 
Sensory deprivation (see also Brainwashing), 

104, 262, 286, 304-305 
Significant variables in psychotherapy (see Psy- 
chotherapy) 

Situational variables (see also Process vari- 
ables), 18, 73-76,324 

Social context of patient, effects on outcome, 18 
Social interaction and psychotherapy (see Psy- 
chotherapy) 

Social processes, theory, 218, 311 
Social role (see also Role expectancies) 
patient, 15 
psychotherapist, 5 
Socioeconomic level 
patient ( see Patient) 
psychotherapist (see Psychotherapist) 
Sound film techniques (see Experimental ana- 
logues) 

Spontaneity (see Psychotherapist) 
Strong Vocational Interest Blank, 45, 263 
Structuredness (see Ambiguity vs. structured- 
ness) 



Success rate of psychotherapist (see also Psy- 
chotherapist), 45 
effect of training, 263 
Suggestion (see Psychotherapist) 

Termination, 280 

Theoretical orientation of psychotherapist (see 
Psychotherapist) 

Therapist (see Psychotherapist) 

Therapeutic personality, general (see Psycho- 
therapist) 

Time-limited psychotherapy, 139-140, 142 

Training of psychotherapist (see Psychother- 
apist) 

Training in psychotherapy research (see Psy- 
chotherapy research) 

Transference, 231, 285-286, 290 

Treatment career (see Patient) 

Treatment variables, 315-316 

Trusting the patient (see Psychotherapist) 

Values of psychotherapist (see Psychotherapist) 

Verbal conditioning (see Operant condition- 
ing) 

Vividness of psychotherapist's communications 
( see Communications ) 

Vocational interests of psychotherapist (see 
Psychotherapist) 
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